Feb 27 01:18:07 devstack cinder-volume[74040]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:18:07 devstack cinder-volume[74040]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:18:07 devstack cinder-volume[74040]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:18:08 devstack cinder-volume[74040]: INFO dbcounter [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Registered counter for database cinder
Feb 27 01:18:08 devstack cinder-volume[74040]: DEBUG oslo_db.sqlalchemy.engines [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:18:08 devstack cinder-volume[74040]: DEBUG dbcounter [-] [74040] Writer thread running {{(pid=74040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:18:08 devstack cinder-volume[74040]: INFO cinder.rpc [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:18:08 devstack cinder-volume[74040]: INFO cinder.rpc [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:18:08 devstack cinder-volume[74040]: DEBUG oslo_db.sqlalchemy.engines [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:18:08 devstack cinder-volume[74040]: INFO cinder.volume.manager [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Determined volume DB was empty at startup.
Feb 27 01:18:08 devstack cinder-volume[74040]: DEBUG cinder.volume.manager [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74040) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:18:08 devstack cinder-volume[74040]: INFO cinder.volume.manager [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 27 01:18:08 devstack cinder-volume[74040]: WARNING stevedore.named [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:18:08 devstack cinder-volume[74040]: WARNING castellan.key_manager [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:18:08 devstack cinder-volume[74040]: WARNING cinder.keymgr.conf_key_mgr [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:18:08 devstack cinder-volume[74040]: DEBUG cinder.volume.drivers.lvm [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74040) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Feb 27 01:18:08 devstack cinder-volume[74040]: DEBUG oslo_concurrency.processutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_concurrency.processutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] CMD "cinder-rtstool verify" returned: 0 in 0.252s {{(pid=74040) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_db.sqlalchemy.engines [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:18:09 devstack cinder-volume[74040]: INFO cinder.rpc [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Feb 27 01:18:09 devstack cinder-volume[74040]: INFO cinder.rpc [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Feb 27 01:18:09 devstack cinder-volume[74040]: WARNING stevedore.named [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:18:09 devstack cinder-volume[74040]: WARNING castellan.key_manager [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:18:09 devstack cinder-volume[74040]: INFO cinder.volume.manager [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_db.sqlalchemy.engines [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:18:09 devstack cinder-volume[74040]: INFO oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Starting 1 workers
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Started child 74139 {{(pid=74040) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Full set of CONF: {{(pid=74040) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] ******************************************************************************** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Configuration options gathered from: {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:18:09 devstack cinder-volume[74139]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] ================================================================================ {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] allow_availability_zone_fallback = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] allow_compression_on_image_upload = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] allowed_direct_url_schemes     = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] api_rate_limit                 = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] auth_strategy                  = keystone {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] az_cache_duration              = 3600 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_availability_zone      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_host                   = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_name                   = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_stats_polling_interval = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backup_api_class               = cinder.backup.api.API {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backup_name_template           = backup-%s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backup_use_same_host           = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backup_use_temp_snapshot       = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] chap_password                  = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] chap_username                  =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_internal_tenant_project_id = 290ae95537cf47f4b1bc3af3b5ada1a0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_internal_tenant_user_id = 354c78362edf413cbfa255bad12d1e9f {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74139]: INFO cinder.volume.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Starting volume driver LVMVolumeDriver (3.0.0)
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cloned_volume_same_az          = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cluster                        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] compression_format             = gzip {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] config_dir                     = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] config_source                  = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] control_exchange               = openstack {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] debug                          = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] default_availability_zone      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] default_group_type             = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] default_volume_type            = lvmdriver-1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] disk_geometry                  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] driver_client_cert             = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] driver_client_cert_key         = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] driver_data_namespace          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] driver_ssl_cert_path           = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] driver_ssl_cert_verify         = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] driver_use_ssl                 = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] enable_force_upload            = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] enable_new_services            = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] enable_unsupported_driver      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] enforce_multipath_for_image_xfer = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] filter_function                = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_api_insecure            = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_api_servers             = ['http://192.168.122.209/image'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_api_ssl_compression     = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_ca_certificates_file    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_certfile                = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_keyfile                 = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_num_retries             = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance_request_timeout         = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] goodness_function              = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] graceful_shutdown_timeout      = 5 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] group_api_class                = cinder.group.api.API {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] host                           = devstack {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_compress_on_upload       = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_conversion_address_space_limit = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_conversion_cpu_limit     = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_conversion_disable       = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_upload_use_cinder_backend = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_upload_use_internal_tenant = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_volume_cache_enabled     = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_volume_cache_max_count   = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] image_volume_cache_max_size_gb = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] init_host_max_objects_retrieval = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] iscsi_target_flags             =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] iscsi_write_cache              = on {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] iser_helper                    = tgtadm {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] iser_ip_address                = 192.168.122.209 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] iser_port                      = 3260 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_color                      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_config_append              = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_dir                        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_file                       = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_options                    = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_rotate_interval            = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_rotate_interval_type       = days {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] log_rotation_type              = none {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] max_age                        = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] max_logfile_count              = 30 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] max_logfile_size_mb            = 200 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] max_over_subscription_ratio    = 20.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] message_reap_interval          = 86400 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] message_ttl                    = 2592000 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] migration_create_volume_timeout_secs = 300 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] monkey_patch                   = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] monkey_patch_modules           = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] my_ip                          = 192.168.122.209 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] no_snapshot_gb_quota           = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] num_iser_scan_tries            = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] num_shell_tries                = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] num_volume_device_scan_tries   = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] nvmeof_conn_info_version       = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] nvmet_ns_id                    = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] nvmet_port_id                  = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_max_limit                = 1000 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_volume_ext_list          = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_volume_listen_port       = 8776 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_volume_use_ssl           = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] osapi_volume_workers           = 2 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] per_volume_size_limit          = -1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] periodic_fuzzy_delay           = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] periodic_interval              = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] public_endpoint                = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] publish_errors                 = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_backup_gigabytes         = 1000 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_backups                  = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_gigabytes                = 1000 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_groups                   = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_snapshots                = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] quota_volumes                  = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] rate_limit_burst               = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] rate_limit_except_level        = CRITICAL {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] rate_limit_interval            = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] reinit_driver_count            = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] replication_device             = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] report_discard_supported       = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] report_interval                = 120 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] reservation_clean_interval     = 86400 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] reservation_expire             = 86400 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] reserved_image_namespaces      = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] reserved_percentage            = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] rpc_response_timeout           = 120 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] run_external_periodic_tasks    = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] scst_target_driver             = iscsi {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] scst_target_iqn_name           = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_down_time              = 720 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] shell_completion               = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] snapshot_name_template         = snapshot-%s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] snapshot_same_host             = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] split_loggers                  = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] state_path                     = /opt/stack/data/cinder {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] storage_availability_zone      = nova {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] storage_protocol               = iSCSI {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] syslog_log_facility            = LOG_USER {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] target_helper                  = lioadm {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] target_ip_address              = 192.168.122.209 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] target_port                    = 3260 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] target_protocol                = iscsi {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] target_secondary_ip_addresses  = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] trace_flags                    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] transport_url                  = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] until_refresh                  = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_chap_auth                  = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_default_quota_class        = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_journal                    = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_json                       = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_multipath_for_image_xfer   = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_stderr                     = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] use_syslog                     = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] verify_glance_signatures       = enabled {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_api_class               = cinder.volume.api.API {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_backend_name            = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_clear                   = zero {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_clear_ionice            = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_clear_size              = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_copy_bps_limit          = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_dd_blocksize            = 1M {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_name_template           = volume-%s {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_service_inithost_offload = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volume_usage_audit_period      = month {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] zoning_mode                    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_concurrency.disable_process_locking = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.admin_password = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.admin_token = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.admin_user  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_port   = 35357 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_protocol = https {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_section = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_type   = password {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_uri    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.auth_version = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.cache       = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.certfile    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.identity_uri = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.include_service_catalog = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.insecure    = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.interface   = public {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.keyfile     = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_password =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcache_username =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.region_name = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.service_token_roles_required = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.service_type = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.backend                  = dogpile.cache.null {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.backend_argument         = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.backend_expiration_time  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.config_prefix            = cache.oslo {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.debug_cache_backend      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.enable_retry_client      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.enable_socket_keepalive  = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.enabled                  = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.enforce_fips_mode        = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.expiration_time          = 600 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.hashclient_retry_attempts = 2 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_dead_retry      = 300 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_sasl_enabled    = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.password                 = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.proxies                  = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.redis_db                 = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.redis_server             = localhost:6379 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.retry_attempts           = 2 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.retry_delay              = 0.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.socket_keepalive_count   = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.socket_keepalive_idle    = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.socket_keepalive_interval = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.socket_timeout           = 1.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.tls_allowed_ciphers      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.tls_cafile               = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.tls_certfile             = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.tls_enabled              = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.tls_keyfile              = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cache.username                 = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] coordination.backend_url       = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.asyncio_connection    = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.asyncio_slave_connection = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.backend               = sqlalchemy {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.connection            = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.connection_debug      = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.connection_parameters =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.connection_recycle_time = 3600 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.connection_trace      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.db_inc_retry_interval = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.db_max_retries        = 20 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.db_max_retry_interval = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.db_retry_interval     = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.max_overflow          = 50 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.max_pool_size         = 5 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.max_retries           = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.mysql_wsrep_sync_wait = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.pool_timeout          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.retry_interval        = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.slave_connection      = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.sqlite_synchronous    = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.synchronous_reader    = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] database.use_db_reconnect      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.connection_string     = messaging:// {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack sudo[74143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.enabled               = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack sudo[74143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.es_doc_type           = notification {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.es_scroll_size        = 10000 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.es_scroll_time        = 2m {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.filter_error_trace    = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.hmac_keys             = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.sentinel_service_name = mymaster {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.socket_timeout        = 0.1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.trace_requests        = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler.trace_sqlalchemy      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler_jaeger.process_tags   = {} {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler_jaeger.service_name_prefix = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] profiler_otlp.service_name_prefix = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.enforce_new_defaults = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: WARNING oslo_config.cfg [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.enforce_scope      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.policy_default_rule = default {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.group          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.helper_command = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] privsep_osbrick.user           = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.group         = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.helper_command = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] cinder_sys_admin.user          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.auth_section      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.auth_type         = password {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.cafile            = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.certfile          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.collect_timing    = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.insecure          = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.keyfile           = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.send_service_user_token = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.split_loggers     = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] service_user.timeout           = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.auth_section            = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.auth_type               = password {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.certfile                = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.collect_timing          = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.insecure                = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.keyfile                 = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.region_name             = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.split_loggers           = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] glance.timeout                 = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.backend_availability_zone = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.chap_password = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.chap_username =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.disk_geometry = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.driver_client_cert = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.driver_client_cert_key = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.driver_data_namespace = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.driver_use_ssl = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.extra_capabilities = {} {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.filter_function = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.goodness_function = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.iscsi_target_flags =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.iscsi_write_cache = on {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.iser_port     = 3260 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.lvm_share_target = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.lvm_type      = auto {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.num_shell_tries = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.replication_device = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.report_discard_supported = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.reserved_percentage = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.target_helper = tgtadm {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.target_port   = 3260 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.target_protocol = iscsi {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.trace_flags   = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.unique_fqdn_network = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.use_chap_auth = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_backend_name = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_clear  = zero {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_clear_ionice = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_clear_size = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_reports.file_event_handler = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_reports.log_dir           = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.backend_host       = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.chap_password      = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.chap_username      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.disk_geometry      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.driver_client_cert = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.extra_capabilities = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.filter_function    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.goodness_function  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.iser_helper        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.iser_port          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.lvm_type           = auto {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.replication_device = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.report_discard_supported = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.reserved_percentage = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.scst_target_driver = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.storage_protocol   = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.target_ip_address  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.target_port        = 3260 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.trace_flags        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_clear       = zero {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] lvmdriver-1.volumes_dir        = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_notifications.driver = [] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_notifications.retry = -1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] key_manager.fixed_key          = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.barbican_api_version  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.barbican_endpoint     = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.barbican_endpoint_type = public {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.barbican_region_name  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.cafile                = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.certfile              = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.collect_timing        = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.insecure              = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.keyfile               = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.number_of_retries     = 60 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.retry_delay           = 1 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.send_service_user_token = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.split_loggers         = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.timeout               = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.verify_ssl            = True {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican.verify_ssl_path       = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.auth_section = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.auth_type = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.cafile   = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.certfile = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.collect_timing = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.insecure = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.keyfile  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.split_loggers = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] barbican_service_user.timeout  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.approle_role_id          = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.approle_secret_id        = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.kv_mountpoint            = secret {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.kv_path                  = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.kv_version               = 2 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.namespace                = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.root_token_id            = **** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.ssl_ca_crt_file          = None {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.timeout                  = 60.0 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.use_ssl                  = False {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:18:09 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] ******************************************************************************** {{(pid=74040) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:18:09 devstack sudo[74143]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:09 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:09 devstack sudo[74152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:09 devstack sudo[74152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:10 devstack sudo[74152]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:10 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.535s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:10 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:18:10 devstack cinder-volume[74139]: INFO cinder.brick.local_dev.lvm [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Feb 27 01:18:10 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:10 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:10 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:10 devstack sudo[74393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:10 devstack sudo[74393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:11 devstack sudo[74393]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:11 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:11 devstack cinder-volume[74139]: DEBUG cinder.brick.local_dev.lvm [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74139) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Feb 27 01:18:11 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:11 devstack sudo[74616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:11 devstack sudo[74616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:12 devstack sudo[74616]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.185s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:12 devstack sudo[74795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:12 devstack sudo[74795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:12 devstack sudo[74795]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:12 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:12 devstack sudo[74829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Feb 27 01:18:12 devstack sudo[74829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:13 devstack sudo[74829]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.486s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:13 devstack sudo[74833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:13 devstack sudo[74833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:13 devstack sudo[74833]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:13 devstack sudo[74838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:13 devstack sudo[74838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:14 devstack sudo[74838]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:14 devstack sudo[74845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:14 devstack sudo[74845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:14 devstack sudo[74845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:14 devstack sudo[74850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:14 devstack sudo[74850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:15 devstack sudo[74850]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:15 devstack sudo[74854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:15 devstack sudo[74854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:15 devstack sudo[74854]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:15 devstack cinder-volume[74139]: INFO cinder.volume.drivers.lvm [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Enabling LVM thin provisioning by default because a thin pool exists.
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:15 devstack sudo[74864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:15 devstack sudo[74864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:16 devstack sudo[74864]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:16 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:16 devstack cinder-volume[74139]: DEBUG cinder.volume.drivers.lvm [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Updating volume stats {{(pid=74139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:18:16 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:16 devstack sudo[74979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:16 devstack sudo[74979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:16 devstack sudo[74979]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:16 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:16 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:16 devstack sudo[75092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:16 devstack sudo[75092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:17 devstack sudo[75092]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:17 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:17 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:17 devstack sudo[75120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:17 devstack sudo[75120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:17 devstack sudo[75120]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:17 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:17 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:17 devstack sudo[75125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:17 devstack sudo[75125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:18 devstack sudo[75125]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:18 devstack cinder-volume[74139]: INFO cinder.volume.driver [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG cinder.volume.driver [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74139) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG oslo_db.sqlalchemy.engines [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG dbcounter [-] [74139] Writer thread running {{(pid=74139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG cinder.db.sqlalchemy.api [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Building query based on filter {{(pid=74139) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG cinder.image.image_utils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74139) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:18:18 devstack cinder-volume[74139]: INFO cinder.keymgr.migration [None req-d4f28021-10da-4dda-84e4-380b2feb029d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG cinder.volume.drivers.lvm [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Updating volume stats {{(pid=74139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:18 devstack sudo[75132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:18 devstack sudo[75132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:18 devstack sudo[75132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:18 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:18 devstack sudo[75135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:18 devstack sudo[75135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:19 devstack sudo[75135]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:19 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:19 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:19 devstack cinder-volume[74040]: DEBUG dbcounter [-] [74040] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74040) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:18:19 devstack sudo[75139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:19 devstack sudo[75139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:19 devstack sudo[75139]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:19 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.540s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:19 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:19 devstack sudo[75145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:19 devstack sudo[75145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:20 devstack sudo[75145]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG cinder.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Notifying Schedulers of capabilities ... {{(pid=74139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:18:20 devstack cinder-volume[74139]: INFO cinder.volume.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Driver initialization completed successfully.
Feb 27 01:18:20 devstack cinder-volume[74139]: INFO cinder.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Initiating service 2 cleanup
Feb 27 01:18:20 devstack cinder-volume[74139]: INFO cinder.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Service 2 cleanup completed.
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG cinder.service [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Creating RPC server for service cinder-volume {{(pid=74139) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG cinder.service [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74139) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:18:20 devstack cinder-volume[74139]: INFO cinder.volume.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG cinder.volume.drivers.lvm [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Updating volume stats {{(pid=74139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:20 devstack sudo[75152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:20 devstack sudo[75152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:20 devstack sudo[75152]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:20 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:20 devstack sudo[75155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:20 devstack sudo[75155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:21 devstack sudo[75155]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:21 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:21 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:21 devstack sudo[75212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:21 devstack sudo[75212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:21 devstack sudo[75212]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:21 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:21 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:21 devstack sudo[75215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:21 devstack sudo[75215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:22 devstack sudo[75215]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:22 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:22 devstack cinder-volume[74139]: INFO cinder.volume.manager [None req-c7330af7-ed40-4b3d-abaf-2add5bfedddc None None] Driver post RPC initialization completed successfully.
Feb 27 01:18:30 devstack cinder-volume[74139]: DEBUG dbcounter [-] [74139] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:18:32 devstack cinder-volume[74139]: DEBUG dbcounter [-] [74139] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=74139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:19:13 devstack cinder-volume[74139]: DEBUG oslo_service.periodic_task [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:19:13 devstack cinder-volume[74139]: DEBUG cinder.volume.drivers.lvm [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Updating volume stats {{(pid=74139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:19:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:13 devstack sudo[77084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:19:13 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:13 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:13 devstack sudo[77126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:19:13 devstack sudo[77126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:14 devstack sudo[77126]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:14 devstack sudo[77189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:19:14 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:14 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:14 devstack sudo[77261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:19:14 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:15 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:15 devstack cinder-volume[74139]: DEBUG cinder.manager [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Notifying Schedulers of capabilities ... {{(pid=74139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:20:13 devstack cinder-volume[74139]: DEBUG oslo_service.periodic_task [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:20:13 devstack cinder-volume[74139]: DEBUG cinder.volume.drivers.lvm [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Updating volume stats {{(pid=74139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:20:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:13 devstack sudo[80412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:20:13 devstack sudo[80412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:13 devstack sudo[80412]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:13 devstack sudo[80415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:20:13 devstack sudo[80415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:14 devstack sudo[80415]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:14 devstack sudo[80419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:20:14 devstack sudo[80419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:14 devstack sudo[80419]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:14 devstack sudo[80422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:20:14 devstack sudo[80422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:15 devstack sudo[80422]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:15 devstack cinder-volume[74139]: DEBUG cinder.manager [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Notifying Schedulers of capabilities ... {{(pid=74139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:20:32 devstack cinder-volume[74139]: DEBUG dbcounter [-] [74139] Writing DB stats cinder:SELECT=1 {{(pid=74139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:20:32 devstack cinder-volume[74139]: DEBUG dbcounter [-] [74139] Writing DB stats cinder:UPDATE=1 {{(pid=74139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:21:13 devstack cinder-volume[74139]: DEBUG oslo_service.periodic_task [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:21:13 devstack cinder-volume[74139]: DEBUG cinder.volume.drivers.lvm [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Updating volume stats {{(pid=74139) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:21:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:13 devstack sudo[82184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:21:13 devstack sudo[82184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:13 devstack sudo[82184]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:13 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:13 devstack sudo[82198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:21:13 devstack sudo[82198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:14 devstack sudo[82198]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.555s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:14 devstack sudo[82225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:21:14 devstack sudo[82225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:14 devstack sudo[82225]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:14 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:14 devstack sudo[82231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:21:14 devstack sudo[82231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:15 devstack sudo[82231]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:15 devstack cinder-volume[74139]: DEBUG oslo_concurrency.processutils [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=74139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:15 devstack cinder-volume[74139]: DEBUG cinder.manager [None req-611aa155-48f8-4074-a0ac-8f6a192902f4 None None] Notifying Schedulers of capabilities ... {{(pid=74139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:16 devstack cinder-volume[74040]: INFO oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Caught SIGTERM, stopping children
Feb 27 01:22:16 devstack cinder-volume[74040]: DEBUG oslo_concurrency.lockutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Acquiring lock "singleton_lock" {{(pid=74040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:22:16 devstack cinder-volume[74040]: DEBUG oslo_concurrency.lockutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Acquired lock "singleton_lock" {{(pid=74040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:22:16 devstack cinder-volume[74040]: DEBUG oslo_concurrency.lockutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Releasing lock "singleton_lock" {{(pid=74040) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:22:16 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Stop services. {{(pid=74040) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 27 01:22:16 devstack cinder-volume[74040]: DEBUG oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Killing children. {{(pid=74040) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 27 01:22:16 devstack cinder-volume[74040]: INFO oslo_service.backend._eventlet.service [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Waiting on 1 children to exit
Feb 27 01:22:21 devstack cinder-volume[74139]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Feb 27 01:22:24 devstack cinder-volume[83353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:22:24 devstack cinder-volume[83353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:22:24 devstack cinder-volume[83353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO dbcounter [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Registered counter for database cinder
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:25 devstack cinder-volume[74139]: DEBUG oslo_concurrency.lockutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Acquiring lock "singleton_lock" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:22:25 devstack cinder-volume[74139]: DEBUG oslo_concurrency.lockutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Acquired lock "singleton_lock" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:22:25 devstack cinder-volume[74139]: DEBUG oslo_concurrency.lockutils [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Releasing lock "singleton_lock" {{(pid=74139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:22:25 devstack cinder-volume[74139]: WARNING amqp [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG dbcounter [-] [83353] Writer thread running {{(pid=83353) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO cinder.rpc [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:22:25 devstack cinder-volume[74139]: WARNING amqp [None req-d59fac94-d0fe-4639-b724-9e3fef02ca11 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO cinder.rpc [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO cinder.volume.manager [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Determined volume DB was empty at startup.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG cinder.volume.manager [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83353) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO cinder.volume.manager [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 27 01:22:25 devstack cinder-volume[83353]: WARNING stevedore.named [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:22:25 devstack cinder-volume[83353]: WARNING castellan.key_manager [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:22:25 devstack cinder-volume[83353]: WARNING cinder.keymgr.conf_key_mgr [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO cinder.volume.manager [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_db.sqlalchemy.engines [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:25 devstack cinder-volume[83353]: INFO oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Starting 1 workers
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Started child 83470 {{(pid=83353) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Full set of CONF: {{(pid=83353) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] ******************************************************************************** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Configuration options gathered from: {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] ================================================================================ {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:22:25 devstack cinder-volume[83470]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] allow_availability_zone_fallback = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] allow_compression_on_image_upload = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] allowed_direct_url_schemes     = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] api_rate_limit                 = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] auth_strategy                  = keystone {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_availability_zone      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_host                   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_name                   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_stats_polling_interval = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backup_api_class               = cinder.backup.api.API {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backup_name_template           = backup-%s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backup_use_same_host           = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backup_use_temp_snapshot       = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] chap_password                  = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] chap_username                  =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_internal_tenant_project_id = 290ae95537cf47f4b1bc3af3b5ada1a0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_internal_tenant_user_id = 354c78362edf413cbfa255bad12d1e9f {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cluster                        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] compression_format             = gzip {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] compute_api_class              = cinder.compute.nova.API {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] config_dir                     = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] config_source                  = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] control_exchange               = openstack {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] debug                          = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] default_availability_zone      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] default_group_type             = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] default_volume_type            = QuobyteHD {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] disk_geometry                  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] driver_client_cert             = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] driver_client_cert_key         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] driver_data_namespace          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] driver_ssl_cert_path           = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] driver_ssl_cert_verify         = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] driver_use_ssl                 = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] enable_new_services            = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] enable_unsupported_driver      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] enabled_backends               = ['QuobyteHD'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] enforce_multipath_for_image_xfer = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] filter_function                = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_api_insecure            = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_api_servers             = ['http://192.168.122.209/image'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_api_ssl_compression     = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_ca_certificates_file    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_catalog_info            = image:glance:publicURL {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_certfile                = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_keyfile                 = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_num_retries             = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance_request_timeout         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] goodness_function              = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] graceful_shutdown_timeout      = 5 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] group_api_class                = cinder.group.api.API {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] host                           = devstack {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_compress_on_upload       = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_conversion_address_space_limit = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_conversion_cpu_limit     = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_conversion_disable       = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_upload_use_cinder_backend = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_upload_use_internal_tenant = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_volume_cache_enabled     = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_volume_cache_max_count   = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] image_volume_cache_max_size_gb = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] init_host_max_objects_retrieval = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] instance_format                = [instance: %(uuid)s]  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] iscsi_target_flags             =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] iscsi_write_cache              = on {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] iser_helper                    = tgtadm {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] iser_ip_address                = 192.168.122.209 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] iser_port                      = 3260 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_color                      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_config_append              = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_dir                        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_file                       = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_options                    = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_rotate_interval            = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_rotate_interval_type       = days {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] log_rotation_type              = none {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] max_age                        = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] max_logfile_count              = 30 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] max_logfile_size_mb            = 200 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] max_over_subscription_ratio    = 20.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] message_reap_interval          = 86400 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] message_ttl                    = 2592000 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] migration_create_volume_timeout_secs = 300 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83470]: INFO cinder.volume.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] monkey_patch                   = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.remotefs [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83470) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] monkey_patch_modules           = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] my_ip                          = 192.168.122.209 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] no_snapshot_gb_quota           = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] num_iser_scan_tries            = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] num_shell_tries                = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] num_volume_device_scan_tries   = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] nvmeof_conn_info_version       = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] nvmet_ns_id                    = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] nvmet_port_id                  = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_max_limit                = 1000 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_volume_ext_list          = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_volume_listen_port       = 8776 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_volume_use_ssl           = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] osapi_volume_workers           = 2 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] per_volume_size_limit          = -1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] periodic_fuzzy_delay           = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] periodic_interval              = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] public_endpoint                = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] publish_errors                 = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_backup_gigabytes         = 1000 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_backups                  = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_gigabytes                = 1000 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_groups                   = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_snapshots                = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] quota_volumes                  = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] rate_limit_burst               = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] rate_limit_except_level        = CRITICAL {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] rate_limit_interval            = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] reinit_driver_count            = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] replication_device             = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] report_discard_supported       = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] report_interval                = 120 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] reservation_clean_interval     = 86400 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] reservation_expire             = 86400 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] reserved_image_namespaces      = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] reserved_percentage            = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] rpc_response_timeout           = 120 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] run_external_periodic_tasks    = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] scst_target_driver             = iscsi {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] scst_target_iqn_name           = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_down_time              = 720 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] shell_completion               = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] snapshot_name_template         = snapshot-%s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] split_loggers                  = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] state_path                     = /opt/stack/data/cinder {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] storage_availability_zone      = nova {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] storage_protocol               = iSCSI {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] syslog_log_facility            = LOG_USER {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] target_helper                  = lioadm {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] target_ip_address              = 192.168.122.209 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] target_port                    = 3260 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] target_protocol                = iscsi {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] target_secondary_ip_addresses  = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] trace_flags                    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] transport_url                  = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] until_refresh                  = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_chap_auth                  = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_default_quota_class        = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_journal                    = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_json                       = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_multipath_for_image_xfer   = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_stderr                     = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] use_syslog                     = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] verify_glance_signatures       = enabled {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_api_class               = cinder.volume.api.API {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_backend_name            = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_clear                   = zero {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_clear_ionice            = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_clear_size              = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_copy_bps_limit          = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_dd_blocksize            = 1M {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_name_template           = volume-%s {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_service_inithost_offload = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volume_usage_audit_period      = month {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] zoning_mode                    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_concurrency.disable_process_locking = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.admin_password = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.admin_token = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.admin_user  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_port   = 35357 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_protocol = https {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_section = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_type   = password {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_uri    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.auth_version = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.cache       = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.certfile    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.delay_auth_decision = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.http_connect_timeout = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.identity_uri = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.include_service_catalog = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.insecure    = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.interface   = public {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.keyfile     = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_password =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcache_username =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.region_name = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.service_token_roles_required = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.service_type = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.token_cache_time = 300 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.backend                  = dogpile.cache.null {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.backend_argument         = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.backend_expiration_time  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.config_prefix            = cache.oslo {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.debug_cache_backend      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.enable_retry_client      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.enable_socket_keepalive  = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.enabled                  = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.enforce_fips_mode        = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.expiration_time          = 600 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.hashclient_retry_attempts = 2 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_dead_retry      = 300 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_pool_maxsize    = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_sasl_enabled    = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.password                 = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.proxies                  = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.redis_db                 = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.redis_sentinel_service_name = mymaster {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.redis_server             = localhost:6379 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.retry_attempts           = 2 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.retry_delay              = 0.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.socket_keepalive_count   = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.socket_keepalive_idle    = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.socket_keepalive_interval = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.socket_timeout           = 1.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.tls_allowed_ciphers      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.tls_cafile               = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.tls_certfile             = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.tls_enabled              = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.tls_keyfile              = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cache.username                 = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] coordination.backend_url       = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.asyncio_connection    = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.asyncio_slave_connection = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.backend               = sqlalchemy {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.connection            = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.connection_debug      = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.connection_parameters =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.connection_recycle_time = 3600 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.connection_trace      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.db_inc_retry_interval = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.db_max_retries        = 20 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.db_max_retry_interval = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.db_retry_interval     = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.max_overflow          = 50 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.max_pool_size         = 5 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.max_retries           = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.mysql_wsrep_sync_wait = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83470) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.pool_timeout          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83470]: WARNING cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.retry_interval        = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83470]: WARNING cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.slave_connection      = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.sqlite_synchronous    = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.synchronous_reader    = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] database.use_db_reconnect      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Running cmd (subprocess): mount.quobyte {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.connection_string     = messaging:// {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.enabled               = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.es_doc_type           = notification {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.es_scroll_size        = 10000 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.es_scroll_time        = 2m {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.filter_error_trace    = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.hmac_keys             = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.sentinel_service_name = mymaster {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.socket_timeout        = 0.1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.trace_requests        = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler.trace_sqlalchemy      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler_jaeger.process_tags   = {} {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler_jaeger.service_name_prefix = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] profiler_otlp.service_name_prefix = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.enforce_new_defaults = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: WARNING oslo_config.cfg [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.enforce_scope      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.policy_default_rule = default {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.policy_file        = policy.yaml {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.group          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.helper_command = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] privsep_osbrick.user           = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.group         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.helper_command = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] cinder_sys_admin.user          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.auth_section      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.auth_type         = password {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.cafile            = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.certfile          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.collect_timing    = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.insecure          = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.keyfile           = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.send_service_user_token = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.split_loggers     = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] service_user.timeout           = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.auth_section            = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.auth_type               = password {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.certfile                = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.collect_timing          = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.insecure                = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.keyfile                 = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.region_name             = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.split_loggers           = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] glance.timeout                 = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.backend_availability_zone = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.chap_password = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.chap_username =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.disk_geometry = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.driver_client_cert = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.driver_client_cert_key = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.driver_data_namespace = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.driver_use_ssl = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.enable_unsupported_driver = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.extra_capabilities = {} {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.filter_function = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.goodness_function = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.iscsi_target_flags =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.iscsi_write_cache = on {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.iser_helper   = tgtadm {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.iser_port     = 3260 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_host      =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_login     = admin {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_mount_options = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_password  = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_private_key =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_share_path =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.num_shell_tries = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.nvmet_port_id = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_client_cfg = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.quobyte_volume_url = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.replication_device = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.report_discard_supported = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.reserved_percentage = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.scst_target_driver = iscsi {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.scst_target_iqn_name = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.storage_protocol = iSCSI {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.target_helper = tgtadm {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.target_port   = 3260 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.target_protocol = iscsi {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.trace_flags   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.unique_fqdn_network = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.use_chap_auth = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_backend_name = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_clear  = zero {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_clear_ionice = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_clear_size = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_reports.file_event_handler = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_reports.log_dir           = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.backend_availability_zone = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.backend_host         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.chap_password        = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.chap_username        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.chiscsi_conf         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.disk_geometry        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.driver_client_cert   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.driver_client_cert_key = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.driver_data_namespace = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.driver_use_ssl       = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.extra_capabilities   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.filter_function      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.goodness_function    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.iser_helper          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.iser_ip_address      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.iser_port            = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.iser_target_prefix   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_host             = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_login            = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_mount_options    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_password         = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_private_key      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_share_path       = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_ssh_port         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.num_shell_tries      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.nvmet_port_id        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.replication_device   = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.report_discard_supported = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.reserved_percentage  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.scst_target_driver   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.storage_protocol     = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.target_helper        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.target_ip_address    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.target_port          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.target_prefix        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.target_protocol      = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.trace_flags          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.use_chap_auth        = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_clear         = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_clear_size    = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] QuobyteHD.volumes_dir          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack quobyte-client[83471]: Reading configuration file: /etc/quobyte/client.cfg
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack quobyte-client[83471]: Invalid parameters found, error: missing mount point.
Feb 27 01:22:25 devstack quobyte-client[83471]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack quobyte-client[83471]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.ssl      = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_notifications.driver = [] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_notifications.retry = -1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] oslo_messaging_notifications.transport_url = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] key_manager.fixed_key          = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.barbican_api_version  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.barbican_endpoint     = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.barbican_endpoint_type = public {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.barbican_region_name  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.cafile                = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.certfile              = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.collect_timing        = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.insecure              = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.keyfile               = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.number_of_retries     = 60 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.retry_delay           = 1 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.send_service_user_token = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.split_loggers         = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.timeout               = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.verify_ssl            = True {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican.verify_ssl_path       = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.auth_section = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.auth_type = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.cafile   = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.certfile = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.collect_timing = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.insecure = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.keyfile  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.split_loggers = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] barbican_service_user.timeout  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.approle_role_id          = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.approle_secret_id        = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.kv_mountpoint            = secret {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.kv_path                  = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.kv_version               = 2 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.namespace                = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.root_token_id            = **** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.ssl_ca_crt_file          = None {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.timeout                  = 60.0 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.use_ssl                  = False {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:25 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] ******************************************************************************** {{(pid=83353) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:25 devstack cinder-volume[83470]: INFO cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 ...
Feb 27 01:22:25 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 -c /etc/quobyte/client-cinder.cfg {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:25 devstack sudo[83472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 -c /etc/quobyte/client-cinder.cfg
Feb 27 01:22:25 devstack sudo[83472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:26 devstack sudo[83472]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.602s {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:26 devstack cinder-volume[83470]: INFO cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 succeeded
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.609s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:26 devstack sudo[83541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:26 devstack sudo[83541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:26 devstack sudo[83541]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.400s {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:26 devstack cinder-volume[83470]: INFO cinder.volume.driver [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG cinder.volume.driver [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7511749267578, 'free_capacity_gb': 1775.7511749267578, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83470) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG dbcounter [-] [83470] Writer thread running {{(pid=83470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG cinder.db.sqlalchemy.api [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Building query based on filter {{(pid=83470) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG cinder.image.image_utils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83470) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:22:26 devstack cinder-volume[83470]: INFO cinder.keymgr.migration [None req-196d4b69-98a6-4c4e-aafb-76ade2c91c40 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:26 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:26 devstack sudo[83544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:26 devstack sudo[83544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:27 devstack sudo[83544]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.439s {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG cinder.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Notifying Schedulers of capabilities ... {{(pid=83470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:27 devstack cinder-volume[83470]: INFO cinder.volume.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Driver initialization completed successfully.
Feb 27 01:22:27 devstack cinder-volume[83470]: INFO cinder.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Initiating service 3 cleanup
Feb 27 01:22:27 devstack cinder-volume[83470]: INFO cinder.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Service 3 cleanup completed.
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG cinder.service [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Creating RPC server for service cinder-volume {{(pid=83470) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG cinder.service [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83470) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:22:27 devstack cinder-volume[83470]: INFO cinder.volume.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:27 devstack sudo[83549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:27 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:27 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:27 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.531s {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:27 devstack cinder-volume[83470]: INFO cinder.volume.manager [None req-ccf17c7f-2e90-460b-ad28-4a09fd2b0f20 None None] Driver post RPC initialization completed successfully.
Feb 27 01:22:30 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:30 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:30 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:30 devstack cinder-volume[83470]: DEBUG cinder.volume.drivers.quobyte [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:30 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83470) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:30 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:30 devstack sudo[83615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:30 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:31 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:31 devstack cinder-volume[83470]: DEBUG oslo_concurrency.processutils [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.449s {{(pid=83470) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:31 devstack cinder-volume[83470]: DEBUG cinder.manager [None req-10f10653-3693-423a-a5a7-f13164c7b912 None None] Notifying Schedulers of capabilities ... {{(pid=83470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:32 devstack cinder-volume[83353]: INFO oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Caught SIGTERM, stopping children
Feb 27 01:22:32 devstack cinder-volume[83353]: DEBUG oslo_concurrency.lockutils [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Acquiring lock "singleton_lock" {{(pid=83353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:22:32 devstack cinder-volume[83353]: DEBUG oslo_concurrency.lockutils [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Acquired lock "singleton_lock" {{(pid=83353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:22:32 devstack cinder-volume[83353]: DEBUG oslo_concurrency.lockutils [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Releasing lock "singleton_lock" {{(pid=83353) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:22:32 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Stop services. {{(pid=83353) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 27 01:22:32 devstack cinder-volume[83353]: DEBUG oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Killing children. {{(pid=83353) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 27 01:22:32 devstack cinder-volume[83353]: INFO oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Waiting on 1 children to exit
Feb 27 01:22:35 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Acquiring lock "singleton_lock" {{(pid=83470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:22:35 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Acquired lock "singleton_lock" {{(pid=83470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:22:35 devstack cinder-volume[83470]: DEBUG oslo_concurrency.lockutils [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Releasing lock "singleton_lock" {{(pid=83470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:22:35 devstack cinder-volume[83470]: WARNING amqp [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:22:35 devstack cinder-volume[83470]: WARNING amqp [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:22:35 devstack cinder-volume[83353]: INFO oslo_service.backend._eventlet.service [None req-3cc71386-dd46-4f1e-89c3-e2584041560b None None] Child 83470 exited with status 0
Feb 27 01:22:37 devstack cinder-volume[83693]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83693) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:22:37 devstack cinder-volume[83693]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83693) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:22:37 devstack cinder-volume[83693]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83693) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:22:38 devstack cinder-volume[83693]: INFO dbcounter [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Registered counter for database cinder
Feb 27 01:22:38 devstack cinder-volume[83693]: DEBUG oslo_db.sqlalchemy.engines [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:38 devstack cinder-volume[83693]: DEBUG dbcounter [-] [83693] Writer thread running {{(pid=83693) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:22:38 devstack cinder-volume[83693]: INFO cinder.rpc [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:22:38 devstack cinder-volume[83693]: INFO cinder.rpc [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:22:38 devstack cinder-volume[83693]: DEBUG oslo_db.sqlalchemy.engines [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:39 devstack cinder-volume[83693]: INFO cinder.volume.manager [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Determined volume DB was empty at startup.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG cinder.volume.manager [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83693) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:22:39 devstack cinder-volume[83693]: WARNING stevedore.named [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:22:39 devstack cinder-volume[83693]: WARNING castellan.key_manager [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:22:39 devstack cinder-volume[83693]: WARNING cinder.keymgr.conf_key_mgr [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:22:39 devstack cinder-volume[83693]: INFO cinder.volume.manager [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_db.sqlalchemy.engines [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:39 devstack cinder-volume[83693]: INFO oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Starting 1 workers
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Started child 83910 {{(pid=83693) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Full set of CONF: {{(pid=83693) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] ******************************************************************************** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Configuration options gathered from: {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] ================================================================================ {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] allow_availability_zone_fallback = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] allow_compression_on_image_upload = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] allowed_direct_url_schemes     = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] api_rate_limit                 = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] auth_strategy                  = keystone {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_availability_zone      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_host                   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_name                   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_stats_polling_interval = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backup_api_class               = cinder.backup.api.API {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backup_name_template           = backup-%s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83910]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backup_use_same_host           = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backup_use_temp_snapshot       = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] chap_password                  = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] chap_username                  =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_internal_tenant_project_id = 290ae95537cf47f4b1bc3af3b5ada1a0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_internal_tenant_user_id = 354c78362edf413cbfa255bad12d1e9f {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cluster                        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] compression_format             = gzip {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] compute_api_class              = cinder.compute.nova.API {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] config_dir                     = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] config_source                  = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] control_exchange               = openstack {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] debug                          = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] default_availability_zone      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] default_group_type             = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] default_volume_type            = QuobyteHD {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] disk_geometry                  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] driver_client_cert             = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] driver_client_cert_key         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] driver_data_namespace          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] driver_ssl_cert_path           = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] driver_ssl_cert_verify         = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] driver_use_ssl                 = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] enable_new_services            = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] enable_unsupported_driver      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] enabled_backends               = ['QuobyteHD'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] enforce_multipath_for_image_xfer = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] filter_function                = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_api_insecure            = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_api_servers             = ['http://192.168.122.209/image'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_api_ssl_compression     = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_ca_certificates_file    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_catalog_info            = image:glance:publicURL {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_certfile                = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_keyfile                 = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_num_retries             = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance_request_timeout         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] goodness_function              = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] graceful_shutdown_timeout      = 5 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] group_api_class                = cinder.group.api.API {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] host                           = devstack {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_compress_on_upload       = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_conversion_address_space_limit = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_conversion_cpu_limit     = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_conversion_disable       = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_upload_use_cinder_backend = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_upload_use_internal_tenant = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_volume_cache_enabled     = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_volume_cache_max_count   = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] image_volume_cache_max_size_gb = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] init_host_max_objects_retrieval = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] instance_format                = [instance: %(uuid)s]  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] iscsi_target_flags             =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] iscsi_write_cache              = on {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] iser_helper                    = tgtadm {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] iser_ip_address                = 192.168.122.209 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] iser_port                      = 3260 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_color                      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_config_append              = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_dir                        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_file                       = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_options                    = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_rotate_interval            = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_rotate_interval_type       = days {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] log_rotation_type              = none {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] max_age                        = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] max_logfile_count              = 30 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] max_logfile_size_mb            = 200 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] max_over_subscription_ratio    = 20.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] message_reap_interval          = 86400 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] message_ttl                    = 2592000 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] migration_create_volume_timeout_secs = 300 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] monkey_patch                   = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] monkey_patch_modules           = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] my_ip                          = 192.168.122.209 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] no_snapshot_gb_quota           = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] num_iser_scan_tries            = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] num_shell_tries                = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] num_volume_device_scan_tries   = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] nvmeof_conn_info_version       = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] nvmet_ns_id                    = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] nvmet_port_id                  = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_max_limit                = 1000 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_volume_ext_list          = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_volume_listen_port       = 8776 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_volume_use_ssl           = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] osapi_volume_workers           = 2 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] per_volume_size_limit          = -1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] periodic_fuzzy_delay           = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] periodic_interval              = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] public_endpoint                = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] publish_errors                 = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_backup_gigabytes         = 1000 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_backups                  = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_gigabytes                = 1000 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_groups                   = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_snapshots                = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] quota_volumes                  = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] rate_limit_burst               = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] rate_limit_except_level        = CRITICAL {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] rate_limit_interval            = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] reinit_driver_count            = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] replication_device             = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] report_discard_supported       = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] report_interval                = 120 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] reservation_clean_interval     = 86400 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] reservation_expire             = 86400 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] reserved_image_namespaces      = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] reserved_percentage            = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] rpc_response_timeout           = 120 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] run_external_periodic_tasks    = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] scst_target_driver             = iscsi {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] scst_target_iqn_name           = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_down_time              = 720 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] shell_completion               = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] snapshot_name_template         = snapshot-%s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] split_loggers                  = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] state_path                     = /opt/stack/data/cinder {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] storage_availability_zone      = nova {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] storage_protocol               = iSCSI {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] syslog_log_facility            = LOG_USER {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] target_helper                  = lioadm {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] target_ip_address              = 192.168.122.209 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] target_port                    = 3260 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] target_protocol                = iscsi {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] target_secondary_ip_addresses  = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] trace_flags                    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] transport_url                  = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] until_refresh                  = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_chap_auth                  = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_default_quota_class        = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_journal                    = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_json                       = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_multipath_for_image_xfer   = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_stderr                     = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] use_syslog                     = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] verify_glance_signatures       = enabled {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_api_class               = cinder.volume.api.API {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_backend_name            = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_clear                   = zero {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_clear_ionice            = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_clear_size              = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_copy_bps_limit          = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_dd_blocksize            = 1M {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_name_template           = volume-%s {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_service_inithost_offload = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volume_usage_audit_period      = month {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] zoning_mode                    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_concurrency.disable_process_locking = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.admin_password = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.admin_token = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.admin_user  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_port   = 35357 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_protocol = https {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_section = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_type   = password {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_uri    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.auth_version = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.cache       = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.certfile    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.delay_auth_decision = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.http_connect_timeout = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.identity_uri = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83910) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.include_service_catalog = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.insecure    = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.interface   = public {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.keyfile     = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_password =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcache_username =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.region_name = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.service_token_roles_required = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.service_type = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.token_cache_time = 300 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.backend                  = dogpile.cache.null {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.backend_argument         = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.backend_expiration_time  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.config_prefix            = cache.oslo {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.debug_cache_backend      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.enable_retry_client      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.enable_socket_keepalive  = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.enabled                  = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.enforce_fips_mode        = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.expiration_time          = 600 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.hashclient_retry_attempts = 2 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_dead_retry      = 300 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_pool_maxsize    = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_sasl_enabled    = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.password                 = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.proxies                  = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.redis_db                 = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.redis_sentinel_service_name = mymaster {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.redis_server             = localhost:6379 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.retry_attempts           = 2 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.retry_delay              = 0.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.socket_keepalive_count   = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.socket_keepalive_idle    = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.socket_keepalive_interval = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.socket_timeout           = 1.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.tls_allowed_ciphers      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.tls_cafile               = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.tls_certfile             = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.tls_enabled              = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.tls_keyfile              = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cache.username                 = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] coordination.backend_url       = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.asyncio_connection    = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.asyncio_slave_connection = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.backend               = sqlalchemy {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.connection            = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.connection_debug      = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.connection_parameters =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.connection_recycle_time = 3600 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.connection_trace      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.db_inc_retry_interval = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.db_max_retries        = 20 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.db_max_retry_interval = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.db_retry_interval     = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.max_overflow          = 50 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.max_pool_size         = 5 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.max_retries           = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.mysql_wsrep_sync_wait = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.pool_timeout          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.retry_interval        = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.slave_connection      = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.sqlite_synchronous    = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.synchronous_reader    = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] database.use_db_reconnect      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.connection_string     = messaging:// {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.enabled               = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.es_doc_type           = notification {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.es_scroll_size        = 10000 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.es_scroll_time        = 2m {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.filter_error_trace    = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.hmac_keys             = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.sentinel_service_name = mymaster {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.socket_timeout        = 0.1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.trace_requests        = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler.trace_sqlalchemy      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler_jaeger.process_tags   = {} {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler_jaeger.service_name_prefix = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] profiler_otlp.service_name_prefix = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.enforce_new_defaults = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: WARNING oslo_config.cfg [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.enforce_scope      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.policy_default_rule = default {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.policy_file        = policy.yaml {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.group          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.helper_command = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] privsep_osbrick.user           = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.group         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.helper_command = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] cinder_sys_admin.user          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.auth_section      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.auth_type         = password {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.cafile            = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.certfile          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.collect_timing    = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.insecure          = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83910) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.keyfile           = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.send_service_user_token = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.split_loggers     = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] service_user.timeout           = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.auth_section            = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.auth_type               = password {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.certfile                = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.collect_timing          = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Running cmd (subprocess): mount.quobyte {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.insecure                = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.keyfile                 = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.region_name             = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.split_loggers           = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] glance.timeout                 = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.backend_availability_zone = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.chap_password = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.chap_username =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.disk_geometry = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.driver_client_cert = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.driver_client_cert_key = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.driver_data_namespace = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.driver_use_ssl = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.enable_unsupported_driver = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.extra_capabilities = {} {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.filter_function = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.goodness_function = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.iscsi_target_flags =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.iscsi_write_cache = on {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.iser_helper   = tgtadm {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.iser_port     = 3260 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_host      =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_login     = admin {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_mount_options = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_password  = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_private_key =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_share_path =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.num_shell_tries = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.nvmet_port_id = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_client_cfg = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.quobyte_volume_url = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.replication_device = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.report_discard_supported = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.reserved_percentage = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.scst_target_driver = iscsi {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.scst_target_iqn_name = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.storage_protocol = iSCSI {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.target_helper = tgtadm {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.target_port   = 3260 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.target_protocol = iscsi {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.trace_flags   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.unique_fqdn_network = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.use_chap_auth = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_backend_name = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_clear  = zero {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_clear_ionice = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_clear_size = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_reports.file_event_handler = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_reports.log_dir           = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.backend_availability_zone = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.backend_host         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.chap_password        = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.chap_username        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.chiscsi_conf         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.disk_geometry        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.driver_client_cert   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.driver_client_cert_key = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.driver_data_namespace = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.driver_use_ssl       = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.extra_capabilities   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.filter_function      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.goodness_function    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.iser_helper          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.iser_ip_address      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.iser_port            = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.iser_target_prefix   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_host             = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_login            = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_mount_options    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_password         = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_private_key      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_share_path       = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_ssh_port         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.num_shell_tries      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.nvmet_port_id        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.replication_device   = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.report_discard_supported = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.reserved_percentage  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.scst_target_driver   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.storage_protocol     = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.target_helper        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.target_ip_address    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.target_port          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.target_prefix        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.target_protocol      = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.trace_flags          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.use_chap_auth        = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_clear         = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_clear_size    = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] QuobyteHD.volumes_dir          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack quobyte-client[83914]: Reading configuration file: /etc/quobyte/client.cfg
Feb 27 01:22:39 devstack quobyte-client[83914]: Invalid parameters found, error: missing mount point.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack quobyte-client[83914]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack quobyte-client[83914]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.ssl      = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_notifications.driver = [] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_notifications.retry = -1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] oslo_messaging_notifications.transport_url = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] key_manager.fixed_key          = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.barbican_api_version  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.barbican_endpoint     = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.barbican_endpoint_type = public {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.barbican_region_name  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.cafile                = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.certfile              = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.collect_timing        = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.insecure              = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.keyfile               = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.number_of_retries     = 60 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.retry_delay           = 1 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.send_service_user_token = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.split_loggers         = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.timeout               = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.verify_ssl            = True {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican.verify_ssl_path       = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.auth_section = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.auth_type = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.cafile   = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.certfile = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.collect_timing = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.insecure = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.keyfile  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.split_loggers = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] barbican_service_user.timeout  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.approle_role_id          = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.approle_secret_id        = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.kv_mountpoint            = secret {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.kv_path                  = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.kv_version               = 2 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.namespace                = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.root_token_id            = **** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.ssl_ca_crt_file          = None {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.timeout                  = 60.0 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.use_ssl                  = False {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:22:39 devstack cinder-volume[83693]: DEBUG oslo_service.backend._eventlet.service [None req-2aacbbb0-7f2d-4080-b2ee-806f748fd8ae None None] ******************************************************************************** {{(pid=83693) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:39 devstack sudo[83925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:39 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:39 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.420s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:39 devstack cinder-volume[83910]: INFO cinder.volume.driver [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.driver [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6537017822266, 'free_capacity_gb': 1775.6537017822266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83910) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writer thread running {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.db.sqlalchemy.api [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Building query based on filter {{(pid=83910) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83910) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:39 devstack cinder-volume[83910]: INFO cinder.keymgr.migration [None req-73bd29ee-386a-4b56-b94f-b0b900aa5336 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:22:39 devstack sudo[83940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:39 devstack sudo[83940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:40 devstack sudo[83940]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.441s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Driver initialization completed successfully.
Feb 27 01:22:40 devstack cinder-volume[83910]: INFO cinder.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Initiating service 3 cleanup
Feb 27 01:22:40 devstack cinder-volume[83910]: INFO cinder.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Service 3 cleanup completed.
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG cinder.service [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Creating RPC server for service cinder-volume {{(pid=83910) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG cinder.service [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83910) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:22:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:40 devstack sudo[83943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:22:40 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:40 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.438s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2e1c84f8-cca7-4f85-9bb3-b7bcf80d8db3 None None] Driver post RPC initialization completed successfully.
Feb 27 01:22:49 devstack cinder-volume[83693]: DEBUG dbcounter [-] [83693] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83693) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:22:50 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:22:50 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=3 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:23:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-711e9a70-1cec-46eb-9328-bb3f7fcd8990 tempest-GroupSnapshotsTest-180033730 None] Group tempest-GroupSnapshotsTest-Group-1545510618: creating
Feb 27 01:23:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-711e9a70-1cec-46eb-9328-bb3f7fcd8990 tempest-GroupSnapshotsTest-180033730 None] Group tempest-GroupSnapshotsTest-Group-1545510618: created successfully
Feb 27 01:23:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-711e9a70-1cec-46eb-9328-bb3f7fcd8990 tempest-GroupSnapshotsTest-180033730 None] Create group completed successfully.
Feb 27 01:23:41 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (14004e11-4689-4484-855e-31414a36a92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcee9cf-40d1-4f61-98e0-ec917598685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcee9cf-40d1-4f61-98e0-ec917598685a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-825050741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f300bb3-1ce4-4f72-ae2b-eb3d79f7fcb4,host='devstack@QuobyteHD#QuobyteHD',id=72f9cf52-a712-4504-9163-77dc8e5119ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:42Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35c4628d-7dc9-4e62-81a4-c6588fc44bd3),volume_type_id=35c4628d-7dc9-4e62-81a4-c6588fc44bd3)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15642d52-335d-4151-a72f-e0603bed7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15642d52-335d-4151-a72f-e0603bed7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55b2971-9b5c-44c8-9c82-e33088dcabc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55b2971-9b5c-44c8-9c82-e33088dcabc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f9cf52-a712-4504-9163-77dc8e5119ad', 'volume_name': 'volume-72f9cf52-a712-4504-9163-77dc8e5119ad', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159af9a3-fa9b-4434-8d76-4fa872a52785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159af9a3-fa9b-4434-8d76-4fa872a52785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf9405f-9e39-465b-b886-66e4f7f9bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Volume 72f9cf52-a712-4504-9163-77dc8e5119ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f9cf52-a712-4504-9163-77dc8e5119ad', 'volume_size': 1}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f300bb3-1ce4-4f72-ae2b-eb3d79f7fcb4,created_at=2026-02-27T00:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-825050741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f300bb3-1ce4-4f72-ae2b-eb3d79f7fcb4,host='devstack@QuobyteHD#QuobyteHD',id=72f9cf52-a712-4504-9163-77dc8e5119ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:42Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35c4628d-7dc9-4e62-81a4-c6588fc44bd3),volume_type_id=35c4628d-7dc9-4e62-81a4-c6588fc44bd3)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Creating volume 72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:42 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:23:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:42 devstack sudo[84283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad 1073741824
Feb 27 01:23:42 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:44 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad 1073741824" returned: 0 in 2.214s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:44 devstack sudo[84636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:23:44 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:45 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 0.718s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] <== create_volume: return (3021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.023s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf9405f-9e39-465b-b886-66e4f7f9bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f9cf52-a712-4504-9163-77dc8e5119ad', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e822e8-3856-4ad6-bc1c-8a1d64bef860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:45 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Volume volume-72f9cf52-a712-4504-9163-77dc8e5119ad (72f9cf52-a712-4504-9163-77dc8e5119ad): created successfully
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e822e8-3856-4ad6-bc1c-8a1d64bef860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (14004e11-4689-4484-855e-31414a36a92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d5e87201-4e56-4201-8eae-526ba06ff463 tempest-GroupSnapshotsTest-180033730 None] Created volume successfully.
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Flow 'volume_create_manager' (8aaadb76-10a6-4a7e-a456-7c20ed1d9862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad235f-2cad-4f13-8b8b-4005865dc492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad235f-2cad-4f13-8b8b-4005865dc492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-636378489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a69331c-2456-426f-b147-9b138372e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c8f93984144fd98a00da4c51f0abea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:45Z,use_quota=True,user_id='a1464b53957d4e3da554d61185351ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821c7af-0a4c-4d12-be86-516c7cf96b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821c7af-0a4c-4d12-be86-516c7cf96b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5b6b5f-c067-493a-8a1a-bd3bb79ea695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5b6b5f-c067-493a-8a1a-bd3bb79ea695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a69331c-2456-426f-b147-9b138372e9dc', 'volume_name': 'volume-7a69331c-2456-426f-b147-9b138372e9dc', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e013c3-b701-407c-9ef4-8e9aa046cc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e013c3-b701-407c-9ef4-8e9aa046cc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bba9596-0067-4178-9596-fb2d738863af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:45 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Volume 7a69331c-2456-426f-b147-9b138372e9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a69331c-2456-426f-b147-9b138372e9dc', 'volume_size': 1}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-636378489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a69331c-2456-426f-b147-9b138372e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c8f93984144fd98a00da4c51f0abea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:45Z,use_quota=True,user_id='a1464b53957d4e3da554d61185351ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Creating volume 7a69331c-2456-426f-b147-9b138372e9dc {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:45 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:23:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:45 devstack sudo[84639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc 1073741824
Feb 27 01:23:45 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] GroupSnapshot f90f7a35-5537-4575-819c-06b0e9f917cf: creating.
Feb 27 01:23:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Group snapshot f90f7a35-5537-4575-819c-06b0e9f917cf: creating. {{(pid=83910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:23:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:47 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc 1073741824" returned: 0 in 1.510s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:47 devstack sudo[84672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc
Feb 27 01:23:47 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:47 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc" returned: 0 in 0.809s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.693s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bba9596-0067-4178-9596-fb2d738863af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a69331c-2456-426f-b147-9b138372e9dc', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe7baec-7af4-485c-90a3-681a3588fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:48 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Volume volume-7a69331c-2456-426f-b147-9b138372e9dc (7a69331c-2456-426f-b147-9b138372e9dc): created successfully
Feb 27 01:23:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe7baec-7af4-485c-90a3-681a3588fef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Flow 'volume_create_manager' (8aaadb76-10a6-4a7e-a456-7c20ed1d9862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-961cebe4-1dc6-408a-b824-a4df9f443604 tempest-VolumesAdminNegativeTest-1748056031 None] Created volume successfully.
Feb 27 01:23:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Creating offline snapshot 421932aa-a3e0-44fe-813b-8ff9335fd0ac of volume 72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:23:48 devstack cinder-volume[83910]: INFO oslo.privsep.daemon [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpx5apvnrf/privsep.sock']
Feb 27 01:23:48 devstack sudo[84680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpx5apvnrf/privsep.sock
Feb 27 01:23:48 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Acquiring lock "cinder-7a69331c-2456-426f-b147-9b138372e9dc-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "cinder-7a69331c-2456-426f-b147-9b138372e9dc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Acquiring lock "cinder-quobyte-7a69331c-2456-426f-b147-9b138372e9dc" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "cinder-quobyte-7a69331c-2456-426f-b147-9b138372e9dc" acquired by "delete_volume" :: waited 0.031s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:49 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:49 devstack cinder-volume[83910]: INFO oslo.privsep.daemon [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Spawned new privsep daemon via rootwrap
Feb 27 01:23:49 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Accepted privsep connection to /tmp/tmpx5apvnrf/privsep.sock {{(pid=83910) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Feb 27 01:23:49 devstack cinder-volume[83910]: INFO oslo.privsep.daemon [-] privsep daemon starting
Feb 27 01:23:49 devstack cinder-volume[83910]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Feb 27 01:23:49 devstack cinder-volume[83910]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Feb 27 01:23:49 devstack cinder-volume[83910]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84689
Feb 27 01:23:49 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[25413016-7b9e-4129-b6ca-9be3ea8eefc9]: (2,) {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:49 devstack cinder-volume[83910]: WARNING oslo_privsep.priv_context [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] privsep daemon already running
Feb 27 01:23:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c37cba-8051-4e2f-893c-e2f7481b53bb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16f9d76-4534-49ec-837a-2a188eaddc59]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:50 devstack sudo[84693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:23:50 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:50 devstack sudo[84694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc
Feb 27 01:23:50 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:50 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 0.805s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:50 devstack sudo[84700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac 1G
Feb 27 01:23:50 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:51 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc" returned: 0 in 1.197s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:51 devstack sudo[84705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc
Feb 27 01:23:51 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:51 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac 1G" returned: 0 in 0.976s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72f9cf52-a712-4504-9163-77dc8e5119ad -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:51 devstack sudo[84711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72f9cf52-a712-4504-9163-77dc8e5119ad -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac
Feb 27 01:23:51 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:52 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7a69331c-2456-426f-b147-9b138372e9dc" returned: 0 in 0.980s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "cinder-quobyte-7a69331c-2456-426f-b147-9b138372e9dc" released by "delete_volume" :: held 2.753s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:52 devstack cinder-volume[83910]: WARNING cinder.quota [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:23:52 devstack cinder-volume[83910]: WARNING cinder.quota [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Created reservations ['6c88d25d-8774-49f1-8adb-2c7e49360c5d', '80a6f34f-ea27-4726-952c-ae06fbc82d17', '389fbbfe-032e-466f-8c22-ee63f9298e4b', '2758c534-df22-4fff-978f-4929b37062cf'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:52 devstack sudo[84745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:23:52 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:53 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72f9cf52-a712-4504-9163-77dc8e5119ad -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac" returned: 0 in 1.241s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:53 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:23:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:53 devstack sudo[84747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac
Feb 27 01:23:53 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:54 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.920s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:54 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:54 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Deleted volume successfully.
Feb 27 01:23:54 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f6b7b9b6-517e-4b59-8ceb-d1b469819e08 tempest-VolumesAdminNegativeTest-1748056031 None] Lock "cinder-7a69331c-2456-426f-b147-9b138372e9dc-delete_volume" released by "delete_volume" :: held 5.375s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac" returned: 0 in 1.690s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:54 devstack sudo[84757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info
Feb 27 01:23:54 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:55 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info" returned: 0 in 0.685s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:55 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:23:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:55 devstack sudo[84776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info
Feb 27 01:23:55 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Flow 'volume_create_manager' (42650ede-c720-4e37-9a62-565fff27b0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef9017e-2566-4410-a9cb-52d7627f286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef9017e-2566-4410-a9cb-52d7627f286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-349229397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9a492f-dfac-4408-8c4a-6ddbea782b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4bb3255ed4487a9aa904621ef1a590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:56Z,use_quota=True,user_id='fe5fc84ced6e4245aada6710c79cc2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3146442-31eb-4ef4-a407-a248929cca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3146442-31eb-4ef4-a407-a248929cca81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c1180c-120b-4d5f-b22c-508d0e211a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c1180c-120b-4d5f-b22c-508d0e211a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9a492f-dfac-4408-8c4a-6ddbea782b61', 'volume_name': 'volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a5b1bc-f553-4a72-8b76-abd7911d2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a5b1bc-f553-4a72-8b76-abd7911d2560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4f3009-fbad-4acb-b453-c37f586961a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Volume 3e9a492f-dfac-4408-8c4a-6ddbea782b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61', 'volume_size': 1}
Feb 27 01:23:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:57 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.info" returned: 0 in 1.606s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.112s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-349229397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9a492f-dfac-4408-8c4a-6ddbea782b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4bb3255ed4487a9aa904621ef1a590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:56Z,use_quota=True,user_id='fe5fc84ced6e4245aada6710c79cc2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Creating volume 3e9a492f-dfac-4408-8c4a-6ddbea782b61 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:57 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:23:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:57 devstack sudo[84780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 1073741824
Feb 27 01:23:57 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2a386fe4-65cc-4dfc-b04b-8ef68e4145c8 tempest-GroupSnapshotsTest-180033730 None] group_snapshot f90f7a35-5537-4575-819c-06b0e9f917cf: created successfully
Feb 27 01:23:58 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 1073741824" returned: 0 in 1.063s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:58 devstack sudo[84788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61
Feb 27 01:23:58 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:59 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61" returned: 0 in 0.940s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4f3009-fbad-4acb-b453-c37f586961a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33982bb1-c700-44a7-9b39-8a490e01e7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:59 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Volume volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 (3e9a492f-dfac-4408-8c4a-6ddbea782b61): created successfully
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33982bb1-c700-44a7-9b39-8a490e01e7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Flow 'volume_create_manager' (42650ede-c720-4e37-9a62-565fff27b0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:59 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a0aefc77-6c07-4085-ae8c-38d03da04835 tempest-ServerRescueNegativeTestJSON-1588577385 None] Created volume successfully.
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-421932aa-a3e0-44fe-813b-8ff9335fd0ac-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-421932aa-a3e0-44fe-813b-8ff9335fd0ac-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Creating volume ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f from snapshot 421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] snapshot: 421932aa-a3e0-44fe-813b-8ff9335fd0ac, volume: ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46153f3-e5ee-4f76-96c5-6753f5cc07e7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:59 devstack sudo[84794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac
Feb 27 01:23:59 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:00 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac" returned: 0 in 0.678s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72f9cf52-a712-4504-9163-77dc8e5119ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:24:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:24:00 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da6ec2a-1cbe-4e3e-bdf5-a9cfd8b2aaff]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:00 devstack sudo[84800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:24:00 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:01 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 0.938s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:01 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:24:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:01 devstack sudo[84805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f
Feb 27 01:24:01 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:06 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" returned: 0 in 5.054s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b64a3-74c4-464a-a514-a61b55bf886e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:06 devstack sudo[84859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:24:06 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:07 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 1.151s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:07 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:24:07 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Converted 1024.00 MB image at 202.57 MB/s
Feb 27 01:24:07 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:07 devstack sudo[84872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f
Feb 27 01:24:07 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:08 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" returned: 0 in 0.653s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" released by "_copy_volume_from_snapshot" :: held 8.666s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-421932aa-a3e0-44fe-813b-8ff9335fd0ac-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" released by "_create_volume_from_snapshot" :: held 8.709s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.731s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4eb0bfd7-e4eb-4eae-9d22-1d2ba3359f7c tempest-GroupSnapshotsTest-180033730 None] Create group from source-snapshot-f90f7a35-5537-4575-819c-06b0e9f917cf completed successfully.
Feb 27 01:24:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b5996-a647-42f9-b819-bdff2dafca2a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:09 devstack sudo[84875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f
Feb 27 01:24:09 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:09 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" returned: 0 in 0.634s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:09 devstack sudo[84881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f
Feb 27 01:24:09 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:10 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" returned: 0 in 0.691s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-ca1018b8-2cb9-4eeb-a72b-b5d65ff7930f" released by "delete_volume" :: held 1.371s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['daebe25f-12a8-47e5-8a8c-c8215f5e71b5'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:10 devstack cinder-volume[83910]: WARNING cinder.quota [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-373720946 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-373720946, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:10 devstack cinder-volume[83910]: WARNING cinder.quota [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-373720946 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-373720946, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['81903ffa-a837-46f6-8b1c-d3a8c98877d8', 'e2a9451c-e4f5-4fbb-bfdb-6563a3b61e4d', 'e55913a7-6984-4d1a-93c4-a51deee82538', '17859cb2-7335-4324-9e93-d055d29d93e2'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:10 devstack sudo[84884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:10 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] group_snapshot f90f7a35-5537-4575-819c-06b0e9f917cf: deleting
Feb 27 01:24:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] group_snapshot f90f7a35-5537-4575-819c-06b0e9f917cf: deleting {{(pid=83910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:24:11 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-72f9cf52-a712-4504-9163-77dc8e5119ad" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:11 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-72f9cf52-a712-4504-9163-77dc8e5119ad" acquired by "delete_snapshot" :: waited 0.044s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:11 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:11 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-421932aa-a3e0-44fe-813b-8ff9335fd0ac" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.171s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:12 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-df4f7d18-dfbc-46b6-9681-5b8e2e9a5474 tempest-GroupSnapshotsTest-180033730 None] Delete group completed successfully.
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-421932aa-a3e0-44fe-813b-8ff9335fd0ac" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Deleting offline snapshot 421932aa-a3e0-44fe-813b-8ff9335fd0ac of volume 72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] snapshot_file for this snap is: volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb52e1a-c8c5-439f-93d0-be5d5924f5f7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:12 devstack sudo[84916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac
Feb 27 01:24:12 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:13 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac" returned: 0 in 1.744s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72f9cf52-a712-4504-9163-77dc8e5119ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb453cd-57b5-4a32-b111-73389ffa0924]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:14 devstack sudo[84922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:24:14 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:15 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 1.227s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:15 devstack sudo[84927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac
Feb 27 01:24:15 devstack sudo[84927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:16 devstack sudo[84927]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac" returned: 0 in 0.958s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:16 devstack sudo[84953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac
Feb 27 01:24:16 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:16 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad.421932aa-a3e0-44fe-813b-8ff9335fd0ac" returned: 0 in 0.625s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-421932aa-a3e0-44fe-813b-8ff9335fd0ac" released by "_delete_snapshot" :: held 4.789s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-72f9cf52-a712-4504-9163-77dc8e5119ad" released by "delete_snapshot" :: held 4.870s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:16 devstack cinder-volume[83910]: WARNING cinder.quota [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-373720946 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-373720946, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:17 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] Created reservations ['bb1565a2-c51d-4bbc-81d7-4b6db709d2fb', '0ad74fa4-f12a-4617-b4b5-9962e0dee5a7', 'fa5f8a4f-add0-493e-b061-4faa2ec8d318', 'c3fa753a-8909-4e0a-be11-9a9217567c09'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6c9d546f-ac76-48c6-b8db-f929435978ab tempest-GroupSnapshotsTest-180033730 None] group_snapshot f90f7a35-5537-4575-819c-06b0e9f917cf: deleted successfully
Feb 27 01:24:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-72f9cf52-a712-4504-9163-77dc8e5119ad" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-72f9cf52-a712-4504-9163-77dc8e5119ad" acquired by "delete_volume" :: waited 0.039s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d98db-16cb-4e84-80e3-66eac0399c5e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Acquiring lock "cinder-3e9a492f-dfac-4408-8c4a-6ddbea782b61-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:18 devstack sudo[84984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:24:18 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "cinder-3e9a492f-dfac-4408-8c4a-6ddbea782b61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Acquiring lock "cinder-quobyte-3e9a492f-dfac-4408-8c4a-6ddbea782b61" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "cinder-quobyte-3e9a492f-dfac-4408-8c4a-6ddbea782b61" acquired by "delete_volume" :: waited 0.029s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f92c08a-e566-4986-bd13-daa4e4d3cad2]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:18 devstack sudo[84988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61
Feb 27 01:24:18 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:19 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 1.088s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:19 devstack sudo[84995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad
Feb 27 01:24:19 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:19 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61" returned: 0 in 1.169s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:19 devstack sudo[85001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61
Feb 27 01:24:19 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:20 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72f9cf52-a712-4504-9163-77dc8e5119ad" returned: 0 in 0.935s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-72f9cf52-a712-4504-9163-77dc8e5119ad" released by "delete_volume" :: held 2.124s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['ed88430c-1300-419b-a0bf-2e6a044a8a4c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:20 devstack cinder-volume[83910]: WARNING cinder.db.sqlalchemy.api [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-373720946']
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['108b0129-b4d4-4971-80d7-0ecaaf9c38d8', '7753ae42-a58b-41b2-b1d6-716e588b6efd', '05bc9082-c51f-4e96-816d-d46cfb2b0fca', 'c7030ca5-c005-421a-9a9b-9d1d672c45c5'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:20 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e9a492f-dfac-4408-8c4a-6ddbea782b61" returned: 0 in 0.863s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "cinder-quobyte-3e9a492f-dfac-4408-8c4a-6ddbea782b61" released by "delete_volume" :: held 2.099s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:20 devstack sudo[85006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:20 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Created reservations ['71e7958f-121b-4def-93cd-573db357e66a', 'fc03518d-3cdb-4876-b331-938302b8ccc5', 'c9895d0c-47a2-4d48-b5f7-545854d4919b', '10cb62af-c206-4992-aec7-ec17b03755e6'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:21 devstack sudo[85009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:21 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:21 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.219s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:21 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:21 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-900c318a-e231-4edd-b83a-b8f60c88a945 tempest-GroupSnapshotsTest-180033730 None] Delete group completed successfully.
Feb 27 01:24:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d2d710b9-2613-463c-9c85-20e6523c3bfb tempest-GroupSnapshotsTest-180033730 None] Group tempest-GroupSnapshotsTest-Group-1328408697: creating
Feb 27 01:24:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d2d710b9-2613-463c-9c85-20e6523c3bfb tempest-GroupSnapshotsTest-180033730 None] Group tempest-GroupSnapshotsTest-Group-1328408697: created successfully
Feb 27 01:24:22 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.687s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Deleted volume successfully.
Feb 27 01:24:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d2d710b9-2613-463c-9c85-20e6523c3bfb tempest-GroupSnapshotsTest-180033730 None] Create group completed successfully.
Feb 27 01:24:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-24093d53-4b12-4028-9db4-6c8213378d3f tempest-ServerRescueNegativeTestJSON-1588577385 None] Lock "cinder-3e9a492f-dfac-4408-8c4a-6ddbea782b61-delete_volume" released by "delete_volume" :: held 4.450s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (99d8d6b3-d686-4ab7-a29c-6bc839ee5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e218f6e-7f23-42ea-b62a-98f4f2b0b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e218f6e-7f23-42ea-b62a-98f4f2b0b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041119789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=622c43e8-395d-43c8-8311-1bcabbfd4a5a,host='devstack@QuobyteHD#QuobyteHD',id=e6c37ced-2f9c-4b43-9dd8-2d8759318a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:24Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c5e1cda-fce8-402b-a9f3-4afe75b68f4c),volume_type_id=3c5e1cda-fce8-402b-a9f3-4afe75b68f4c)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643579da-384c-456e-9966-15a1357f08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643579da-384c-456e-9966-15a1357f08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8dda12-fb46-4b70-b272-5d6ac06c76da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8dda12-fb46-4b70-b272-5d6ac06c76da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c37ced-2f9c-4b43-9dd8-2d8759318a7b', 'volume_name': 'volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68c1120-d9af-4bd1-bd43-edf0088c0fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68c1120-d9af-4bd1-bd43-edf0088c0fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a5f1b-54bd-41da-9f7e-1a76bcb19235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:24 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Volume e6c37ced-2f9c-4b43-9dd8-2d8759318a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b', 'volume_size': 1}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=622c43e8-395d-43c8-8311-1bcabbfd4a5a,created_at=2026-02-27T00:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041119789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=622c43e8-395d-43c8-8311-1bcabbfd4a5a,host='devstack@QuobyteHD#QuobyteHD',id=e6c37ced-2f9c-4b43-9dd8-2d8759318a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:24Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c5e1cda-fce8-402b-a9f3-4afe75b68f4c),volume_type_id=3c5e1cda-fce8-402b-a9f3-4afe75b68f4c)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Creating volume e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:24 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:24 devstack sudo[85047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b 1073741824
Feb 27 01:24:24 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:25 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b 1073741824" returned: 0 in 0.778s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:25 devstack sudo[85053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b
Feb 27 01:24:25 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:26 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" returned: 0 in 0.818s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a5f1b-54bd-41da-9f7e-1a76bcb19235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2f460d-409c-47cc-b0ef-2735083b708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Volume volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b (e6c37ced-2f9c-4b43-9dd8-2d8759318a7b): created successfully
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2f460d-409c-47cc-b0ef-2735083b708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (99d8d6b3-d686-4ab7-a29c-6bc839ee5821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:26 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-0c711b30-228e-4989-80e9-4436473b914b tempest-GroupSnapshotsTest-180033730 None] Created volume successfully.
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (6f944d50-4ff0-4129-a5c6-f9b6c0eb8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab9b386-aba3-4b66-9430-afc398d47ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab9b386-aba3-4b66-9430-afc398d47ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015396698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=622c43e8-395d-43c8-8311-1bcabbfd4a5a,host='devstack@QuobyteHD#QuobyteHD',id=d1810600-11df-49d1-a388-f731dfc5f31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:27Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c5e1cda-fce8-402b-a9f3-4afe75b68f4c),volume_type_id=3c5e1cda-fce8-402b-a9f3-4afe75b68f4c)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac262ab-770b-4f50-917b-caecff09a630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac262ab-770b-4f50-917b-caecff09a630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d749e809-a005-471e-8785-526d7e095102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d749e809-a005-471e-8785-526d7e095102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1810600-11df-49d1-a388-f731dfc5f31a', 'volume_name': 'volume-d1810600-11df-49d1-a388-f731dfc5f31a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1e3dff-4021-4154-9f4e-64b783c85c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1e3dff-4021-4154-9f4e-64b783c85c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e316cd07-b075-40b8-bf34-7bde601299cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:27 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Volume d1810600-11df-49d1-a388-f731dfc5f31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1810600-11df-49d1-a388-f731dfc5f31a', 'volume_size': 1}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=622c43e8-395d-43c8-8311-1bcabbfd4a5a,created_at=2026-02-27T00:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015396698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=622c43e8-395d-43c8-8311-1bcabbfd4a5a,host='devstack@QuobyteHD#QuobyteHD',id=d1810600-11df-49d1-a388-f731dfc5f31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:27Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c5e1cda-fce8-402b-a9f3-4afe75b68f4c),volume_type_id=3c5e1cda-fce8-402b-a9f3-4afe75b68f4c)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Creating volume d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:27 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:27 devstack sudo[85057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a 1073741824
Feb 27 01:24:27 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:27 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a 1073741824" returned: 0 in 0.855s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:27 devstack sudo[85063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a
Feb 27 01:24:27 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:28 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a" returned: 0 in 0.826s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e316cd07-b075-40b8-bf34-7bde601299cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1810600-11df-49d1-a388-f731dfc5f31a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa09cea-8a55-4038-868e-16478579729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:28 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Volume volume-d1810600-11df-49d1-a388-f731dfc5f31a (d1810600-11df-49d1-a388-f731dfc5f31a): created successfully
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa09cea-8a55-4038-868e-16478579729d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (6f944d50-4ff0-4129-a5c6-f9b6c0eb8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bc642b26-c5c4-4578-a400-2cae0446abb4 tempest-GroupSnapshotsTest-180033730 None] Created volume successfully.
Feb 27 01:24:29 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f0ee7d10-81be-4469-a64a-f6a92dad10e6 tempest-GroupSnapshotsTest-180033730 None] Update group completed successfully.
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:30 devstack sudo[85066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:30 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:30 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=61,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=6 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:24:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=63,cinder:UPDATE=76,cinder:INSERT=19,cinder:DELETE=1 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:24:31 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ff2c829c-0427-4d8c-bd73-e78e83e02cc6 tempest-GroupSnapshotsTest-180033730 None] Update group completed successfully.
Feb 27 01:24:31 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.602s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:32 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-111f7cff-e8a0-4418-96ac-c9b3e661c81c tempest-GroupSnapshotsTest-180033730 None] Update group completed successfully.
Feb 27 01:24:33 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-edb31b5b-7f31-4a74-ac99-ae6f59b60bbe tempest-GroupSnapshotsTest-180033730 None] Update group completed successfully.
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Flow 'volume_create_manager' (c1ab7e5d-84f1-43c9-b430-eb4c479cc0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379280a1-b589-44f8-b940-35657b6bce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379280a1-b589-44f8-b940-35657b6bce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-816305046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06737be5-d058-4f78-ac7a-47fc5ac21505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc564e04f13047edbbdca03945f9d84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:34Z,use_quota=True,user_id='39cb3eeaf0c14a10bc0d79ded5c6c9fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1187a83-a61f-4a13-8c3e-ae1dc56bdf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1187a83-a61f-4a13-8c3e-ae1dc56bdf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b34e1f-c177-4910-b65e-2b9159ee67a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b34e1f-c177-4910-b65e-2b9159ee67a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06737be5-d058-4f78-ac7a-47fc5ac21505', 'volume_name': 'volume-06737be5-d058-4f78-ac7a-47fc5ac21505', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc062b3-59c5-4d8c-ae96-a56b59f53e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc062b3-59c5-4d8c-ae96-a56b59f53e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb4ef26-e18d-46e2-8a3d-57ad031a7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:33 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Volume 06737be5-d058-4f78-ac7a-47fc5ac21505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06737be5-d058-4f78-ac7a-47fc5ac21505', 'volume_size': 1}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-816305046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06737be5-d058-4f78-ac7a-47fc5ac21505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc564e04f13047edbbdca03945f9d84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:34Z,use_quota=True,user_id='39cb3eeaf0c14a10bc0d79ded5c6c9fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Creating volume 06737be5-d058-4f78-ac7a-47fc5ac21505 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:33 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:33 devstack sudo[85098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505 1073741824
Feb 27 01:24:33 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:34 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505 1073741824" returned: 0 in 0.608s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:34 devstack sudo[85103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505
Feb 27 01:24:34 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:34 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] GroupSnapshot deb86e84-a40e-4d03-bdbc-10ff1f6c018b: creating.
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Group snapshot deb86e84-a40e-4d03-bdbc-10ff1f6c018b: creating. {{(pid=83910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:34 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505" returned: 0 in 0.509s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.079s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Creating offline snapshot 0b049eed-e468-4004-befb-9f7a4a5cc719 of volume e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb4ef26-e18d-46e2-8a3d-57ad031a7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06737be5-d058-4f78-ac7a-47fc5ac21505', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec1ad61-365e-4cb3-911c-e5e99b268fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f8454-23f7-45d2-b0b3-42ce4087e813]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:34 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Volume volume-06737be5-d058-4f78-ac7a-47fc5ac21505 (06737be5-d058-4f78-ac7a-47fc5ac21505): created successfully
Feb 27 01:24:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec1ad61-365e-4cb3-911c-e5e99b268fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Flow 'volume_create_manager' (c1ab7e5d-84f1-43c9-b430-eb4c479cc0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:35 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-569e83bb-ca6d-4c63-80e1-6de541aada6a tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Created volume successfully.
Feb 27 01:24:35 devstack sudo[85106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b
Feb 27 01:24:35 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:35 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" returned: 0 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:35 devstack sudo[85111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 1G
Feb 27 01:24:35 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:36 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 1G" returned: 0 in 0.815s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:36 devstack sudo[85116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719
Feb 27 01:24:36 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Acquiring lock "cinder-06737be5-d058-4f78-ac7a-47fc5ac21505-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "cinder-06737be5-d058-4f78-ac7a-47fc5ac21505-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Acquiring lock "cinder-quobyte-06737be5-d058-4f78-ac7a-47fc5ac21505" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "cinder-quobyte-06737be5-d058-4f78-ac7a-47fc5ac21505" acquired by "delete_volume" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1274cb7-708a-49a3-b694-d553f2f24e16]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:36 devstack sudo[85118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505
Feb 27 01:24:36 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:37 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719" returned: 0 in 0.659s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:37 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[85123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719
Feb 27 01:24:37 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:37 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505" returned: 0 in 0.688s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[85129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505
Feb 27 01:24:37 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:37 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719" returned: 0 in 0.666s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[85132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info
Feb 27 01:24:37 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-06737be5-d058-4f78-ac7a-47fc5ac21505" returned: 0 in 0.623s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "cinder-quobyte-06737be5-d058-4f78-ac7a-47fc5ac21505" released by "delete_volume" :: held 1.351s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Created reservations ['4c93ea12-746e-47ab-b509-2286b5538a5d', '95a2f1b5-132e-4630-9440-ddd63cb616c9', '6135c16f-7d8d-42aa-a279-925c838d8fae', 'ad32c442-0362-44c6-bbf6-fba485a386b3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:38 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info" returned: 0 in 0.513s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:38 devstack sudo[85136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:38 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:38 devstack sudo[85138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:38 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.info" returned: 0 in 0.538s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.905s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Creating offline snapshot ca9967e0-6ea8-43b0-ac93-ec0c57661600 of volume d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eebda01-6503-49b4-86f7-242039e78477]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:39 devstack sudo[85144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a
Feb 27 01:24:39 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:39 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.796s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:39 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Deleted volume successfully.
Feb 27 01:24:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-858e31a8-95df-4330-899c-488003aa12d7 tempest-VolumeQuotasNegativeTestJSON-1954030221 None] Lock "cinder-06737be5-d058-4f78-ac7a-47fc5ac21505-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:39 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a" returned: 0 in 0.659s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:39 devstack sudo[85151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 1G
Feb 27 01:24:39 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:40 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 1G" returned: 0 in 0.742s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1810600-11df-49d1-a388-f731dfc5f31a -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:40 devstack sudo[85156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1810600-11df-49d1-a388-f731dfc5f31a -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600
Feb 27 01:24:40 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:40 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1810600-11df-49d1-a388-f731dfc5f31a -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600" returned: 0 in 0.565s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:40 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:40 devstack sudo[85161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600
Feb 27 01:24:40 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:41 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600" returned: 0 in 0.535s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:41 devstack sudo[85171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info
Feb 27 01:24:41 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:41 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info" returned: 0 in 0.522s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:41 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:41 devstack sudo[85174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info
Feb 27 01:24:41 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:42 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.info" returned: 0 in 0.529s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.636s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c2156439-a505-4561-a3af-0af6eb40a84f tempest-GroupSnapshotsTest-180033730 None] group_snapshot deb86e84-a40e-4d03-bdbc-10ff1f6c018b: created successfully
Feb 27 01:24:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] group_snapshot deb86e84-a40e-4d03-bdbc-10ff1f6c018b: deleting
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] group_snapshot deb86e84-a40e-4d03-bdbc-10ff1f6c018b: deleting {{(pid=83910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-0b049eed-e468-4004-befb-9f7a4a5cc719" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-0b049eed-e468-4004-befb-9f7a4a5cc719" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Deleting offline snapshot 0b049eed-e468-4004-befb-9f7a4a5cc719 of volume e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] snapshot_file for this snap is: volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea178b1-19a6-474b-af49-6e09b07b61cc]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:43 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719
Feb 27 01:24:43 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Flow 'volume_create_manager' (e96cf3b6-658e-41ce-9e26-99acf25a04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8475994f-a3ec-45ae-afe3-3cfcc9e99c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8475994f-a3ec-45ae-afe3-3cfcc9e99c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-632604509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2daccd-01bf-466e-9376-c7b66043d60d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88174ba67bba4a839f5ea73f7d5a21ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:44Z,use_quota=True,user_id='17a6439a12da42bc8bd836ce2ccfd198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2373cfb2-4701-4c58-91d7-14d96ee08da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2373cfb2-4701-4c58-91d7-14d96ee08da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f60cf1-91de-4057-ba7b-608eafcd5e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f60cf1-91de-4057-ba7b-608eafcd5e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2daccd-01bf-466e-9376-c7b66043d60d', 'volume_name': 'volume-aa2daccd-01bf-466e-9376-c7b66043d60d', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edf9887-3d08-4523-be11-5611952cff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edf9887-3d08-4523-be11-5611952cff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e9d5cd-0508-4a28-87cc-0bdc5c5af74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Volume aa2daccd-01bf-466e-9376-c7b66043d60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2daccd-01bf-466e-9376-c7b66043d60d', 'volume_size': 1}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-632604509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2daccd-01bf-466e-9376-c7b66043d60d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88174ba67bba4a839f5ea73f7d5a21ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:44Z,use_quota=True,user_id='17a6439a12da42bc8bd836ce2ccfd198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Creating volume aa2daccd-01bf-466e-9376-c7b66043d60d {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:44 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:44 devstack sudo[85214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d 1073741824
Feb 27 01:24:44 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Flow 'volume_create_manager' (9515dbcf-8733-4356-a2f7-e5a51d92b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600f4bc8-59c2-48f9-8ee4-4db323105470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600f4bc8-59c2-48f9-8ee4-4db323105470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1030621863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2a1292-d106-4c80-8392-05e314be08d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ae4f631b7845d8aba964d3d9129cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:44Z,use_quota=True,user_id='41f043fa024b44e59898493901010d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5aca674-ed67-4538-aec5-3155c860d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5aca674-ed67-4538-aec5-3155c860d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f48cbf6-bfc1-4f50-9584-ee1159cb2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f48cbf6-bfc1-4f50-9584-ee1159cb2c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2a1292-d106-4c80-8392-05e314be08d5', 'volume_name': 'volume-9c2a1292-d106-4c80-8392-05e314be08d5', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdada08-6ebf-4b7e-b400-20a0f38efb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdada08-6ebf-4b7e-b400-20a0f38efb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a42d10f-0d5d-44bb-a866-f0daeb2bd936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:44 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Volume 9c2a1292-d106-4c80-8392-05e314be08d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2a1292-d106-4c80-8392-05e314be08d5', 'volume_size': 1}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:44 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719" returned: 0 in 0.862s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb3106-0350-461b-ad7c-bd3376803a87]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:44 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b
Feb 27 01:24:44 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:45 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d 1073741824" returned: 0 in 0.791s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:45 devstack sudo[85235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d
Feb 27 01:24:45 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:45 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" returned: 0 in 0.721s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:45 devstack sudo[85246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719
Feb 27 01:24:45 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:45 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d" returned: 0 in 0.486s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1030621863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2a1292-d106-4c80-8392-05e314be08d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ae4f631b7845d8aba964d3d9129cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:44Z,use_quota=True,user_id='41f043fa024b44e59898493901010d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Creating volume 9c2a1292-d106-4c80-8392-05e314be08d5 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:45 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:45 devstack sudo[85249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5 1073741824
Feb 27 01:24:45 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e9d5cd-0508-4a28-87cc-0bdc5c5af74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2daccd-01bf-466e-9376-c7b66043d60d', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cb15cb-8b8e-4971-95fa-16a37fd89afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:45 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Volume volume-aa2daccd-01bf-466e-9376-c7b66043d60d (aa2daccd-01bf-466e-9376-c7b66043d60d): created successfully
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cb15cb-8b8e-4971-95fa-16a37fd89afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Flow 'volume_create_manager' (e96cf3b6-658e-41ce-9e26-99acf25a04b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3327830c-d085-4f49-ab9e-a1e9759df9b9 tempest-VolumesTestJSON-822114328 None] Created volume successfully.
Feb 27 01:24:45 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719" returned: 0 in 0.544s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:45 devstack sudo[85254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719
Feb 27 01:24:45 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:46 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5 1073741824" returned: 0 in 0.597s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:46 devstack sudo[85259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5
Feb 27 01:24:46 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:46 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b.0b049eed-e468-4004-befb-9f7a4a5cc719" returned: 0 in 0.509s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-0b049eed-e468-4004-befb-9f7a4a5cc719" released by "_delete_snapshot" :: held 2.733s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" released by "delete_snapshot" :: held 2.776s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-d1810600-11df-49d1-a388-f731dfc5f31a" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-d1810600-11df-49d1-a388-f731dfc5f31a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-ca9967e0-6ea8-43b0-ac93-ec0c57661600" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-ca9967e0-6ea8-43b0-ac93-ec0c57661600" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Deleting offline snapshot ca9967e0-6ea8-43b0-ac93-ec0c57661600 of volume d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] snapshot_file for this snap is: volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff152c-d5f4-47f0-a321-754559509d54]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:46 devstack sudo[85262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600
Feb 27 01:24:46 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Flow 'volume_create_manager' (20fc38e8-9255-463c-abb5-f9444b61cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443b1106-b802-4a47-8927-16cb2fd7d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443b1106-b802-4a47-8927-16cb2fd7d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-968121325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec68ba-4794-48df-8f69-bc4b99237512,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88174ba67bba4a839f5ea73f7d5a21ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:47Z,use_quota=True,user_id='17a6439a12da42bc8bd836ce2ccfd198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4f7e2e-ab88-45ee-a2dc-1301e8dd5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4f7e2e-ab88-45ee-a2dc-1301e8dd5c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6ddaeb-d7b9-4216-b364-a28f62dd4ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6ddaeb-d7b9-4216-b364-a28f62dd4ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ec68ba-4794-48df-8f69-bc4b99237512', 'volume_name': 'volume-44ec68ba-4794-48df-8f69-bc4b99237512', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c12fa5-1a0f-461c-b920-33bc2c4f38ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:46 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c12fa5-1a0f-461c-b920-33bc2c4f38ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c9c60f-1411-40c7-bfa0-6b308f1d1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:46 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Volume 44ec68ba-4794-48df-8f69-bc4b99237512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ec68ba-4794-48df-8f69-bc4b99237512', 'volume_size': 1}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5" returned: 0 in 0.600s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-968121325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec68ba-4794-48df-8f69-bc4b99237512,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88174ba67bba4a839f5ea73f7d5a21ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:47Z,use_quota=True,user_id='17a6439a12da42bc8bd836ce2ccfd198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Creating volume 44ec68ba-4794-48df-8f69-bc4b99237512 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:46 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a42d10f-0d5d-44bb-a866-f0daeb2bd936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2a1292-d106-4c80-8392-05e314be08d5', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:46 devstack sudo[85265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512 1073741824
Feb 27 01:24:46 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b733593-0a97-487c-9801-cef4042db712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:46 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Volume volume-9c2a1292-d106-4c80-8392-05e314be08d5 (9c2a1292-d106-4c80-8392-05e314be08d5): created successfully
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b733593-0a97-487c-9801-cef4042db712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Flow 'volume_create_manager' (9515dbcf-8733-4356-a2f7-e5a51d92b090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-937aca5e-9f47-4f81-a45a-fd4c734ed462 tempest-VolumesServicesTestJSON-588659144 None] Created volume successfully.
Feb 27 01:24:47 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600" returned: 0 in 0.636s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1810600-11df-49d1-a388-f731dfc5f31a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1402edf4-571c-4307-ae10-a10f6828dcf6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:47 devstack sudo[85270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a
Feb 27 01:24:47 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:47 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512 1073741824" returned: 0 in 0.614s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:47 devstack sudo[85278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512
Feb 27 01:24:47 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Acquiring lock "cinder-9c2a1292-d106-4c80-8392-05e314be08d5-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Lock "cinder-9c2a1292-d106-4c80-8392-05e314be08d5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Acquiring lock "cinder-quobyte-9c2a1292-d106-4c80-8392-05e314be08d5" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Lock "cinder-quobyte-9c2a1292-d106-4c80-8392-05e314be08d5" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7df146-1479-4095-8e0b-be3822eaae06]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:47 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a" returned: 0 in 0.645s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:47 devstack sudo[85285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600
Feb 27 01:24:47 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:47 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5
Feb 27 01:24:47 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:47 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512" returned: 0 in 0.489s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c9c60f-1411-40c7-bfa0-6b308f1d1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ec68ba-4794-48df-8f69-bc4b99237512', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e73e36-98ef-4674-b367-c71c71b56dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:48 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Volume volume-44ec68ba-4794-48df-8f69-bc4b99237512 (44ec68ba-4794-48df-8f69-bc4b99237512): created successfully
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e73e36-98ef-4674-b367-c71c71b56dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Flow 'volume_create_manager' (20fc38e8-9255-463c-abb5-f9444b61cc69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-700bf188-3ca5-4bd9-9055-54318c525bf7 tempest-VolumesTestJSON-822114328 None] Created volume successfully.
Feb 27 01:24:48 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600" returned: 0 in 0.522s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:48 devstack sudo[85295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600
Feb 27 01:24:48 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:48 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5" returned: 0 in 0.571s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:48 devstack sudo[85297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5
Feb 27 01:24:48 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:48 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a.ca9967e0-6ea8-43b0-ac93-ec0c57661600" returned: 0 in 0.419s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-ca9967e0-6ea8-43b0-ac93-ec0c57661600" released by "_delete_snapshot" :: held 2.292s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:48 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-d1810600-11df-49d1-a388-f731dfc5f31a" released by "delete_snapshot" :: held 2.309s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c2a1292-d106-4c80-8392-05e314be08d5" returned: 0 in 0.433s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Lock "cinder-quobyte-9c2a1292-d106-4c80-8392-05e314be08d5" released by "delete_volume" :: held 1.052s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Created reservations ['accaf568-670d-4036-8be2-24b8f6f20c77', 'c3fd7922-5426-402d-ae83-c0048d6fc05e', 'c492eeb5-5d19-4bdf-9337-28366949e8ff', '1bfbf168-9469-4a43-acfd-1c02ad087169'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:48 devstack cinder-volume[83910]: WARNING cinder.quota [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1670324169 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1670324169, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:48 devstack cinder-volume[83910]: WARNING cinder.quota [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1670324169 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1670324169, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['4fe00e3e-bea9-41e2-8207-ef6368f99410', '8e0d5116-1383-411b-96b8-2fab8e2b00d4', 'afa730c5-444f-4af7-a635-85b0dce36a4e', 'bc8dab83-16e2-4298-9ccf-9bdb05c1880c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:48 devstack sudo[85301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:48 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['2a018efb-c9c4-42c3-9d57-5bdfc82ad4b9', 'df7078d7-9ad7-48b9-9019-d4ba6fbef397', 'c99c6728-4643-4df2-9d3b-7e79c57521a3', '40a6a87e-fccd-41fe-893b-9662757c47dc'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:49 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f9862509-6dea-4958-bc52-66e3a7200774 tempest-GroupSnapshotsTest-180033730 None] group_snapshot deb86e84-a40e-4d03-bdbc-10ff1f6c018b: deleted successfully
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Flow 'volume_create_manager' (2b5ba5d4-87d6-4e2c-b4a4-286817bef26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44797da8-4efb-4fed-9268-de3377e7615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44797da8-4efb-4fed-9268-de3377e7615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555644966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8ccd61-a73f-4365-9212-d8e0d6c86185,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88174ba67bba4a839f5ea73f7d5a21ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:49Z,use_quota=True,user_id='17a6439a12da42bc8bd836ce2ccfd198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb18aad-5028-4f56-bd29-41250e710c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb18aad-5028-4f56-bd29-41250e710c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b8d2c4-004f-4588-861c-a52e5352ede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b8d2c4-004f-4588-861c-a52e5352ede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8ccd61-a73f-4365-9212-d8e0d6c86185', 'volume_name': 'volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c1a2c1-9aac-48dc-a712-24da3031de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c1a2c1-9aac-48dc-a712-24da3031de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380e53fb-c8b5-4a31-8871-44c08af818d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Volume 6b8ccd61-a73f-4365-9212-d8e0d6c86185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185', 'volume_size': 1}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555644966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8ccd61-a73f-4365-9212-d8e0d6c86185,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88174ba67bba4a839f5ea73f7d5a21ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:49Z,use_quota=True,user_id='17a6439a12da42bc8bd836ce2ccfd198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Creating volume 6b8ccd61-a73f-4365-9212-d8e0d6c86185 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:49 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:49 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 1073741824
Feb 27 01:24:49 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:49 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.838s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:49 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Deleted volume successfully.
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6e7d807-bb33-424c-bf76-5809a631e588 tempest-VolumesServicesTestJSON-588659144 None] Lock "cinder-9c2a1292-d106-4c80-8392-05e314be08d5-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-d1810600-11df-49d1-a388-f731dfc5f31a" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-d1810600-11df-49d1-a388-f731dfc5f31a" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[733ef9db-ff7d-48c0-849c-3cf3999fc12f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:50 devstack sudo[85332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a
Feb 27 01:24:50 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:50 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 1073741824" returned: 0 in 0.886s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:50 devstack sudo[85339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185
Feb 27 01:24:50 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:51 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a" returned: 0 in 1.046s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:51 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a
Feb 27 01:24:51 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:51 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185" returned: 0 in 0.738s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380e53fb-c8b5-4a31-8871-44c08af818d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fa2171-7511-416b-b906-90e575be42ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Volume volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 (6b8ccd61-a73f-4365-9212-d8e0d6c86185): created successfully
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fa2171-7511-416b-b906-90e575be42ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Flow 'volume_create_manager' (2b5ba5d4-87d6-4e2c-b4a4-286817bef26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:51 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d1131d06-fd81-4cba-918e-0cc2d4ffb9f1 tempest-VolumesTestJSON-822114328 None] Created volume successfully.
Feb 27 01:24:51 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d1810600-11df-49d1-a388-f731dfc5f31a" returned: 0 in 0.651s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-d1810600-11df-49d1-a388-f731dfc5f31a" released by "delete_volume" :: held 1.763s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e99794-de16-48b5-950d-cea3fee0114e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:51 devstack sudo[85348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b
Feb 27 01:24:51 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Acquiring lock "cinder-6b8ccd61-a73f-4365-9212-d8e0d6c86185-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Lock "cinder-6b8ccd61-a73f-4365-9212-d8e0d6c86185-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Acquiring lock "cinder-quobyte-6b8ccd61-a73f-4365-9212-d8e0d6c86185" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Lock "cinder-quobyte-6b8ccd61-a73f-4365-9212-d8e0d6c86185" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a91d57a-dcb4-45d4-915b-a8b016d8a4b8]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:52 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" returned: 0 in 0.907s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:52 devstack sudo[85354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b
Feb 27 01:24:52 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:52 devstack sudo[85353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185
Feb 27 01:24:52 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Flow 'volume_create_manager' (6261f950-7d35-4032-bf21-aa3686bed5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eed8b71-2603-46b4-9498-f5a7efe3c74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eed8b71-2603-46b4-9498-f5a7efe3c74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741529416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a8310-e981-43f1-b85d-c8542415dddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502063c1ad884364b005474e9d46af3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:53Z,use_quota=True,user_id='00194e1380454c79b0b19fdd3168c36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1196216-f061-42f8-bac8-942cb3de0118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1196216-f061-42f8-bac8-942cb3de0118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab86a32-75bd-424a-9dd7-7b28bce3a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab86a32-75bd-424a-9dd7-7b28bce3a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703a8310-e981-43f1-b85d-c8542415dddb', 'volume_name': 'volume-703a8310-e981-43f1-b85d-c8542415dddb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11768ee-1065-4d01-ba4c-0068071e87d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11768ee-1065-4d01-ba4c-0068071e87d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bb44b5-c762-4d25-8503-86adcf77d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:53 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Volume 703a8310-e981-43f1-b85d-c8542415dddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703a8310-e981-43f1-b85d-c8542415dddb', 'volume_size': 1}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741529416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a8310-e981-43f1-b85d-c8542415dddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502063c1ad884364b005474e9d46af3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:53Z,use_quota=True,user_id='00194e1380454c79b0b19fdd3168c36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Creating volume 703a8310-e981-43f1-b85d-c8542415dddb {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:53 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:53 devstack sudo[85360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb 1073741824
Feb 27 01:24:53 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:53 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185" returned: 0 in 0.809s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:53 devstack sudo[85363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185
Feb 27 01:24:53 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:53 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" returned: 0 in 0.827s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-e6c37ced-2f9c-4b43-9dd8-2d8759318a7b" released by "delete_volume" :: held 1.784s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['df4e6e83-81e0-4aa9-94f3-652238e314ff'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:53 devstack cinder-volume[83910]: WARNING cinder.quota [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1670324169 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1670324169, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['bb93198d-7a64-4d9d-801f-7afe0d612b5e', 'c7cc301c-01b2-43f7-ac10-41a86740e521', '710497ba-7751-40d6-8837-bfbe26f88e08', '5e6213b0-2d6b-4469-84f3-a1670c50ab01'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['44f2e6f2-9c92-4ea6-9e74-ea5090711e6f', '10152411-c471-410a-b5ca-f7d30edf38e8', '3c37b654-ab19-4199-814e-fd813cf7c7f2', '290dbe85-52f1-4ee8-bb2b-a65f70b4ea1c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:53 devstack sudo[85366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:53 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:54 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb 1073741824" returned: 0 in 0.861s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:54 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:54 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6b8ccd61-a73f-4365-9212-d8e0d6c86185" returned: 0 in 0.851s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:54 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Lock "cinder-quobyte-6b8ccd61-a73f-4365-9212-d8e0d6c86185" released by "delete_volume" :: held 1.744s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Created reservations ['e27e968c-9c1b-40ff-9cd0-dac3d8301b77', '1d8215a4-c314-4ae5-95a4-50b52b96f7a9', 'b7525354-11c8-481f-924f-f49cca80422e', '5f0986fe-0112-4779-9b2b-d22cc8a6af8f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:54 devstack sudo[85373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:54 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Acquiring lock "cinder-44ec68ba-4794-48df-8f69-bc4b99237512-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Lock "cinder-44ec68ba-4794-48df-8f69-bc4b99237512-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Acquiring lock "cinder-quobyte-44ec68ba-4794-48df-8f69-bc4b99237512" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Lock "cinder-quobyte-44ec68ba-4794-48df-8f69-bc4b99237512" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9964df4-8aa8-4532-add8-2c864f78900f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2d6d6d47-5881-4a42-b431-44055c3770fe tempest-GroupSnapshotsTest-180033730 None] Group tempest-GroupSnapshotsTest-Group-1101868586: creating
Feb 27 01:24:55 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.205s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d6db80c7-b830-4918-8920-775c8049f6a1 tempest-GroupSnapshotsTest-180033730 None] Delete group completed successfully.
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb" returned: 0 in 0.893s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2d6d6d47-5881-4a42-b431-44055c3770fe tempest-GroupSnapshotsTest-180033730 None] Group tempest-GroupSnapshotsTest-Group-1101868586: created successfully
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bb44b5-c762-4d25-8503-86adcf77d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703a8310-e981-43f1-b85d-c8542415dddb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d21668-07e9-4f0b-9a43-a71756fff791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Volume volume-703a8310-e981-43f1-b85d-c8542415dddb (703a8310-e981-43f1-b85d-c8542415dddb): created successfully
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d21668-07e9-4f0b-9a43-a71756fff791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Flow 'volume_create_manager' (6261f950-7d35-4032-bf21-aa3686bed5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2d6d6d47-5881-4a42-b431-44055c3770fe tempest-GroupSnapshotsTest-180033730 None] Create group completed successfully.
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-de248423-9eb6-41eb-b643-08192852e896 tempest-DeleteServersTestJSON-1336671576 None] Created volume successfully.
Feb 27 01:24:55 devstack sudo[85377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512
Feb 27 01:24:55 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:55 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.004s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Deleted volume successfully.
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ce402cf-5668-4c94-a5df-98a18f503850 tempest-VolumesTestJSON-822114328 None] Lock "cinder-6b8ccd61-a73f-4365-9212-d8e0d6c86185-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:55 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512" returned: 0 in 0.805s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:55 devstack sudo[85384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512
Feb 27 01:24:55 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:56 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44ec68ba-4794-48df-8f69-bc4b99237512" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Lock "cinder-quobyte-44ec68ba-4794-48df-8f69-bc4b99237512" released by "delete_volume" :: held 1.357s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Created reservations ['d2e1a2a1-37e1-4593-a277-d1bd519152f0', 'abf8ca00-03c5-4769-8c63-1ec4bb489f87', '85006717-2665-4362-a4be-60fd0a9ae3c1', 'c6b72692-5a31-4be3-b663-5cdb394efb9d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[85387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:56 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (53185cc9-4e31-4238-8e50-1e685e5a2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfaa95b-daa6-4694-86a1-34a710cf6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfaa95b-daa6-4694-86a1-34a710cf6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611339228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8dcf7492-835f-4123-af39-8dd763c76be8,host='devstack@QuobyteHD#QuobyteHD',id=3312626c-a5ae-4530-a5f0-a44d0630c7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:57Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(493f7b03-c085-4669-9b6a-9f9f4bcdea1e),volume_type_id=493f7b03-c085-4669-9b6a-9f9f4bcdea1e)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7656067b-e4a8-45d0-8a43-f90b31900ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7656067b-e4a8-45d0-8a43-f90b31900ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf94e22-c732-4201-bb6c-09d7978e7e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf94e22-c732-4201-bb6c-09d7978e7e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3312626c-a5ae-4530-a5f0-a44d0630c7ed', 'volume_name': 'volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896317c0-9e59-493e-9670-3f868bfbd5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896317c0-9e59-493e-9670-3f868bfbd5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e2f9cc-5e2c-4073-81ed-5ac68313d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Volume 3312626c-a5ae-4530-a5f0-a44d0630c7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed', 'volume_size': 1}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8dcf7492-835f-4123-af39-8dd763c76be8,created_at=2026-02-27T00:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611339228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8dcf7492-835f-4123-af39-8dd763c76be8,host='devstack@QuobyteHD#QuobyteHD',id=3312626c-a5ae-4530-a5f0-a44d0630c7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3343c6540e4357900a7b3dafe6f22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:57Z,use_quota=True,user_id='43a16aa3251a4276ae8541eaac3bc244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(493f7b03-c085-4669-9b6a-9f9f4bcdea1e),volume_type_id=493f7b03-c085-4669-9b6a-9f9f4bcdea1e)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Creating volume 3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:56 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:24:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[85389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed 1073741824
Feb 27 01:24:56 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:57 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.686s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Deleted volume successfully.
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9804ade8-d368-425d-b2c0-f36b7db9b0f0 tempest-VolumesTestJSON-822114328 None] Lock "cinder-44ec68ba-4794-48df-8f69-bc4b99237512-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Acquiring lock "cinder-aa2daccd-01bf-466e-9376-c7b66043d60d-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Lock "cinder-aa2daccd-01bf-466e-9376-c7b66043d60d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Acquiring lock "cinder-quobyte-aa2daccd-01bf-466e-9376-c7b66043d60d" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Lock "cinder-quobyte-aa2daccd-01bf-466e-9376-c7b66043d60d" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5000ed-f538-4289-ba63-75c95c53a711]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:57 devstack sudo[85395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d
Feb 27 01:24:57 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:57 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed 1073741824" returned: 0 in 0.749s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:57 devstack sudo[85398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed
Feb 27 01:24:57 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:58 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d" returned: 0 in 0.665s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:58 devstack sudo[85403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d
Feb 27 01:24:58 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:58 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed" returned: 0 in 0.705s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e2f9cc-5e2c-4073-81ed-5ac68313d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3beaf15-2d61-478e-9bb7-f0c76bc8551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:58 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Volume volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed (3312626c-a5ae-4530-a5f0-a44d0630c7ed): created successfully
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3beaf15-2d61-478e-9bb7-f0c76bc8551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Flow 'volume_create_manager' (53185cc9-4e31-4238-8e50-1e685e5a2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:58 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-fb5a4f8e-9b51-4de4-ad92-b91412a50470 tempest-GroupSnapshotsTest-180033730 None] Created volume successfully.
Feb 27 01:24:58 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-aa2daccd-01bf-466e-9376-c7b66043d60d" returned: 0 in 0.611s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Lock "cinder-quobyte-aa2daccd-01bf-466e-9376-c7b66043d60d" released by "delete_volume" :: held 1.330s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Created reservations ['d38ec930-44f5-4e1e-8e14-dbb518e3ed0a', '571a9273-ee47-4fe5-a8fd-550934bfaada', '2066a468-f5fc-403c-9fa2-43f15d1c61db', 'a1735817-40b3-4a6c-bff2-70d99bfd8e76'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:58 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:24:58 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:59 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] GroupSnapshot 929efecc-2303-458b-bacf-f8d346c35cd8: creating.
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Group snapshot 929efecc-2303-458b-bacf-f8d346c35cd8: creating. {{(pid=83910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Creating offline snapshot 774fc0bb-7778-4666-b765-c7f5092d4930 of volume 3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa1d4d-4525-4cd1-8957-4a09a7538f33]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:59 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.677s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:59 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Deleted volume successfully.
Feb 27 01:24:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1abc1309-8d59-42d5-8ae8-449e823f730e tempest-VolumesTestJSON-822114328 None] Lock "cinder-aa2daccd-01bf-466e-9376-c7b66043d60d-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:59 devstack sudo[85412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed
Feb 27 01:24:59 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:00 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed" returned: 0 in 1.210s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:00 devstack sudo[85419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 1G
Feb 27 01:25:00 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:01 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 1G" returned: 0 in 0.861s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:01 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930
Feb 27 01:25:01 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:01 devstack cinder-volume[83910]: WARNING py.warnings [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Feb 27 01:25:01 devstack cinder-volume[83910]:   .first()
Feb 27 01:25:01 devstack cinder-volume[83910]: 
Feb 27 01:25:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:01 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930" returned: 0 in 0.553s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:01 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:25:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:01 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930
Feb 27 01:25:01 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:02 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930" returned: 0 in 0.590s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:02 devstack sudo[85443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info
Feb 27 01:25:02 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:03 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info" returned: 0 in 0.628s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:03 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:03 devstack sudo[85446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info
Feb 27 01:25:03 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:03 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Flow 'volume_create_manager' (c99dafb7-26d4-4b23-b809-aa554724e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75c997e-f79d-4980-a70c-e487988bd420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75c997e-f79d-4980-a70c-e487988bd420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-467217644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e656b7f7-9949-4aed-a3cc-077076305948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef04811cc5d141b887f8ca575acc860d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:04Z,use_quota=True,user_id='30f2462c16cd4bb8b607c758a3405ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f221c637-24bf-4483-b0a3-9e888837cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f221c637-24bf-4483-b0a3-9e888837cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ad5495-a812-4fc5-ae31-1928c0f3121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ad5495-a812-4fc5-ae31-1928c0f3121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e656b7f7-9949-4aed-a3cc-077076305948', 'volume_name': 'volume-e656b7f7-9949-4aed-a3cc-077076305948', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5512da-c8a3-4efd-a795-9ba196434cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5512da-c8a3-4efd-a795-9ba196434cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204216c0-1a01-4979-99da-2f89dcf10541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:03 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Volume e656b7f7-9949-4aed-a3cc-077076305948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e656b7f7-9949-4aed-a3cc-077076305948', 'volume_size': 1}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.info" returned: 0 in 0.675s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.287s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bd2252-bd11-4241-933a-00f12ddcbedd]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:03 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cc55b464-d02b-4eff-bdcb-6c8ba4be37ea tempest-GroupSnapshotsTest-180033730 None] group_snapshot 929efecc-2303-458b-bacf-f8d346c35cd8: created successfully
Feb 27 01:25:03 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb
Feb 27 01:25:03 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:04 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb" returned: 0 in 0.635s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.646s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-467217644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e656b7f7-9949-4aed-a3cc-077076305948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef04811cc5d141b887f8ca575acc860d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:04Z,use_quota=True,user_id='30f2462c16cd4bb8b607c758a3405ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Creating volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:04 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:04 devstack sudo[85454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 1073741824
Feb 27 01:25:04 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9', 'name': 'volume-703a8310-e981-43f1-b85d-c8542415dddb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3409fe99-ebc7-48b9-bdc5-0b2f3b466e86', 'enforce_multipath': True} {{(pid=83910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 01:25:04 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-3ce79ccb-4f2a-4704-9d63-9abc6da7d776 req-e25d1938-4319-44bb-8cd0-f5fc495739e1 tempest-DeleteServersTestJSON-1336671576 None] attachment_update completed successfully.
Feb 27 01:25:04 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] group_snapshot 929efecc-2303-458b-bacf-f8d346c35cd8: deleting
Feb 27 01:25:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] group_snapshot 929efecc-2303-458b-bacf-f8d346c35cd8: deleting {{(pid=83910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-3312626c-a5ae-4530-a5f0-a44d0630c7ed" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-3312626c-a5ae-4530-a5f0-a44d0630c7ed" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-774fc0bb-7778-4666-b765-c7f5092d4930" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-774fc0bb-7778-4666-b765-c7f5092d4930" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Deleting offline snapshot 774fc0bb-7778-4666-b765-c7f5092d4930 of volume 3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] snapshot_file for this snap is: volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b74e082-1e77-4dde-8dd8-5d393057a732]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:05 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930
Feb 27 01:25:05 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:05 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 1073741824" returned: 0 in 0.800s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:05 devstack sudo[85601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948
Feb 27 01:25:05 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:05 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948" returned: 0 in 0.579s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204216c0-1a01-4979-99da-2f89dcf10541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e656b7f7-9949-4aed-a3cc-077076305948', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55302c58-db76-45c6-aecb-c6c29a0f1085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Volume volume-e656b7f7-9949-4aed-a3cc-077076305948 (e656b7f7-9949-4aed-a3cc-077076305948): created successfully
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55302c58-db76-45c6-aecb-c6c29a0f1085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Flow 'volume_create_manager' (c99dafb7-26d4-4b23-b809-aa554724e118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:06 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930" returned: 0 in 0.975s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf244f5-44d8-4384-b681-41e6ae49f3e7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:06 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5a11b170-4bbb-4c0b-b87e-99618d8d233a tempest-SnapshotsActionsTest-468003378 None] Created volume successfully.
Feb 27 01:25:06 devstack sudo[85678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed
Feb 27 01:25:06 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:06 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed" returned: 0 in 0.608s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:06 devstack sudo[86001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930
Feb 27 01:25:06 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Creating offline snapshot d8f94499-5882-4309-93af-10e40fd64a63 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d6aa0-0373-4257-b669-175d3d03ea71]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:07 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930" returned: 0 in 0.643s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:07 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948
Feb 27 01:25:07 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:07 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930
Feb 27 01:25:07 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:07 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948" returned: 0 in 0.668s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:07 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 1G
Feb 27 01:25:07 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:07 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed.774fc0bb-7778-4666-b765-c7f5092d4930" returned: 0 in 0.633s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-774fc0bb-7778-4666-b765-c7f5092d4930" released by "_delete_snapshot" :: held 2.930s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-3312626c-a5ae-4530-a5f0-a44d0630c7ed" released by "delete_snapshot" :: held 2.953s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:08 devstack cinder-volume[83910]: WARNING cinder.quota [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-276510885 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-276510885, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:08 devstack cinder-volume[83910]: WARNING cinder.quota [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-276510885 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-276510885, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] Created reservations ['be3f6ef9-666d-4924-846e-4497918f7399', '13d20db6-aedf-4a21-8edc-ebf905f54861', '83ab34ce-c9d2-4e73-81d0-d4e29d47cad7', '96dbcc11-4399-430a-9c67-718739b5b51e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5ee97d0f-f348-427e-ba3b-bd8f6cbd8e82 tempest-GroupSnapshotsTest-180033730 None] group_snapshot 929efecc-2303-458b-bacf-f8d346c35cd8: deleted successfully
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "cinder-quobyte-3312626c-a5ae-4530-a5f0-a44d0630c7ed" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-3312626c-a5ae-4530-a5f0-a44d0630c7ed" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:08 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 1G" returned: 0 in 0.725s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9585241d-d71e-47a6-8bb2-e5096dcf0abc]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:08 devstack sudo[86020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:08 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:08 devstack sudo[86021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed
Feb 27 01:25:08 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:09 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.498s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:09 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 is being set with open permissions: ugo+rw
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:09 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:09 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:09 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed" returned: 0 in 0.642s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:09 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed
Feb 27 01:25:09 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Flow 'volume_create_manager' (6a1fc7e7-52dd-45bb-b525-9c3c79c601aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc34b4a5-92f4-4d6d-96f7-6755de3e0ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc34b4a5-92f4-4d6d-96f7-6755de3e0ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-721916028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a5e1ac-2a96-4ae7-a3de-597998394c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5389c4507b418da721a0c87c674e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:10Z,use_quota=True,user_id='0a9261a0ead846049523c56deab0c29c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d134de-1232-4ceb-903b-f48570a9fb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d134de-1232-4ceb-903b-f48570a9fb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e18fe99-9064-4a12-870c-b62c23c82f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e18fe99-9064-4a12-870c-b62c23c82f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a5e1ac-2a96-4ae7-a3de-597998394c86', 'volume_name': 'volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafaeebe-1950-42c1-a7d4-1af3b1128c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafaeebe-1950-42c1-a7d4-1af3b1128c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846e1f24-078a-416e-b0a0-d19d7149b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:09 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Volume e1a5e1ac-2a96-4ae7-a3de-597998394c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86', 'volume_size': 1}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:09 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.752s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:09 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3312626c-a5ae-4530-a5f0-a44d0630c7ed" returned: 0 in 0.648s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:09 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info
Feb 27 01:25:09 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Lock "cinder-quobyte-3312626c-a5ae-4530-a5f0-a44d0630c7ed" released by "delete_volume" :: held 1.340s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Created reservations ['d5ec4c38-b5e8-4e5d-8cfd-4d2679de2fff'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:10 devstack cinder-volume[83910]: WARNING cinder.quota [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-276510885 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-276510885, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Created reservations ['4f22d621-3bd0-4567-85e3-cbd5751c618d', 'f693d8d7-6aaa-47c0-86e6-27f113080fe5', '24da528f-58e8-4f8f-ab62-902ac6470583', '5de0a88a-392b-4757-a96c-a897a7151935'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:10 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:10 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:10 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info" returned: 0 in 0.506s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:10 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info is being set with open permissions: ugo+rw
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:10 devstack sudo[86041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info
Feb 27 01:25:10 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:10 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:10 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-560cfdbd-0075-46ce-87ba-1783d4b6d39d tempest-GroupSnapshotsTest-180033730 None] Delete group completed successfully.
Feb 27 01:25:10 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.info" returned: 0 in 0.498s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.734s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-721916028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a5e1ac-2a96-4ae7-a3de-597998394c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5389c4507b418da721a0c87c674e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:10Z,use_quota=True,user_id='0a9261a0ead846049523c56deab0c29c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Creating volume e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:10 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:11 devstack sudo[86116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 1073741824
Feb 27 01:25:11 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-09ea9c57-ce81-498d-b322-2bef519a061a tempest-SnapshotsActionsTest-468003378 None] Create snapshot completed successfully
Feb 27 01:25:11 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 1073741824" returned: 0 in 0.837s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:11 devstack sudo[86188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86
Feb 27 01:25:11 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:12 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.285s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Creating offline snapshot 2e4b474d-0a18-4267-85f7-3c42f0ef1151 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846e1f24-078a-416e-b0a0-d19d7149b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8deb529-72ae-40f2-82d0-126c977ea948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec1c8e-ec7c-473d-ada6-24a271a6216a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:12 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Volume volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 (e1a5e1ac-2a96-4ae7-a3de-597998394c86): created successfully
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8deb529-72ae-40f2-82d0-126c977ea948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Flow 'volume_create_manager' (6a1fc7e7-52dd-45bb-b525-9c3c79c601aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:12 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cbc885b4-af50-42e1-9543-7a10bed90fe7 tempest-SnapshotMetadataTestJSON-606873473 None] Created volume successfully.
Feb 27 01:25:12 devstack sudo[86191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:12 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:13 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.638s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 1G
Feb 27 01:25:13 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:13 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 1G" returned: 0 in 0.570s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151
Feb 27 01:25:13 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-fce2aff5-6c3d-4c26-ae0d-542124da4526 req-6816ed19-67ef-4ce1-91fd-4162f2b28a64 tempest-DeleteServersTestJSON-1336671576 None] Terminate volume connection completed successfully.
Feb 27 01:25:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-fce2aff5-6c3d-4c26-ae0d-542124da4526 req-6816ed19-67ef-4ce1-91fd-4162f2b28a64 tempest-DeleteServersTestJSON-1336671576 None] Deleting attachment 3409fe99-ebc7-48b9-bdc5-0b2f3b466e86. {{(pid=83910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 01:25:14 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:14 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 is being set with open permissions: ugo+rw
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:14 devstack sudo[86207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151
Feb 27 01:25:14 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:14 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151" returned: 0 in 0.488s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.702s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Creating offline snapshot b09ed11d-e7be-4d61-b67a-358d0efa327f of volume e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4eab08-3fd5-484a-8f6d-fd63a2f49289]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-634dd1d9-6519-41de-b04e-a6e8097921e8 tempest-SnapshotsActionsTest-468003378 None] Create snapshot completed successfully
Feb 27 01:25:14 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86
Feb 27 01:25:14 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-358a4c07-05c4-4401-a42c-4052d79d4086 tempest-GroupSnapshotsV319Test-2103883969 None] Group tempest-GroupSnapshotsV319Test-Group-1645871389: creating
Feb 27 01:25:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-358a4c07-05c4-4401-a42c-4052d79d4086 tempest-GroupSnapshotsV319Test-2103883969 None] Group tempest-GroupSnapshotsV319Test-Group-1645871389: created successfully
Feb 27 01:25:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-358a4c07-05c4-4401-a42c-4052d79d4086 tempest-GroupSnapshotsV319Test-2103883969 None] Create group completed successfully.
Feb 27 01:25:15 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86" returned: 0 in 0.527s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:15 devstack sudo[86215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f 1G
Feb 27 01:25:15 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-2e4b474d-0a18-4267-85f7-3c42f0ef1151-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-2e4b474d-0a18-4267-85f7-3c42f0ef1151-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-2e4b474d-0a18-4267-85f7-3c42f0ef1151" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-2e4b474d-0a18-4267-85f7-3c42f0ef1151" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Deleting offline snapshot 2e4b474d-0a18-4267-85f7-3c42f0ef1151 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] snapshot_file for this snap is: volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d798a8a9-a27e-4665-b07f-9185c9cc333b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:15 devstack sudo[86217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151
Feb 27 01:25:15 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:15 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f 1G" returned: 0 in 0.520s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:15 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f
Feb 27 01:25:15 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:15 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151" returned: 0 in 0.555s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8db93-1322-4ca5-aab5-c37c7a0af43d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:16 devstack sudo[86227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:16 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:16 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f" returned: 0 in 0.554s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:16 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f is being set with open permissions: ugo+rw
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:16 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f
Feb 27 01:25:16 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Flow 'volume_create_manager' (17ee8ecd-33bb-488b-ac72-a3d570700147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97d32d8-0ff8-4997-ad59-efc8372629cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97d32d8-0ff8-4997-ad59-efc8372629cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111529372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e13d7518-7053-4de3-962c-e8ef91f32838,host='devstack@QuobyteHD#QuobyteHD',id=5ea312c4-fea5-43e0-a76a-4f8cf9c9e591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3644467e2d84aa0b59d4fab1bd68b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:16Z,use_quota=True,user_id='237e4a13675a48f8a0dd6ef5af73a58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b369084-80e0-49a3-92e4-e8e5108599ba),volume_type_id=8b369084-80e0-49a3-92e4-e8e5108599ba)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c04159-3910-464c-987d-bc519f9ed42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c04159-3910-464c-987d-bc519f9ed42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afa1408-ad71-4d07-bc79-57688c81e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afa1408-ad71-4d07-bc79-57688c81e76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea312c4-fea5-43e0-a76a-4f8cf9c9e591', 'volume_name': 'volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626f77c7-cb58-448c-9cf6-f2e56d953b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626f77c7-cb58-448c-9cf6-f2e56d953b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900a5a22-12d8-409c-a50a-2c4b10189656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:16 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Volume 5ea312c4-fea5-43e0-a76a-4f8cf9c9e591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591', 'volume_size': 1}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:16 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.683s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:16 devstack sudo[86237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151
Feb 27 01:25:16 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:16 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f" returned: 0 in 0.485s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:16 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info
Feb 27 01:25:16 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151" returned: 0 in 0.527s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:17 devstack sudo[86245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151
Feb 27 01:25:17 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:17 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info is being set with open permissions: ugo+rw
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:17 devstack sudo[86248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info
Feb 27 01:25:17 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Acquiring lock "cinder-703a8310-e981-43f1-b85d-c8542415dddb-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Lock "cinder-703a8310-e981-43f1-b85d-c8542415dddb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Acquiring lock "cinder-quobyte-703a8310-e981-43f1-b85d-c8542415dddb" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Lock "cinder-quobyte-703a8310-e981-43f1-b85d-c8542415dddb" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88397e-d416-44ac-85d7-24e0f13d900e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:17 devstack sudo[86250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb
Feb 27 01:25:17 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.2e4b474d-0a18-4267-85f7-3c42f0ef1151" returned: 0 in 0.492s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-2e4b474d-0a18-4267-85f7-3c42f0ef1151" released by "_delete_snapshot" :: held 2.320s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" released by "delete_snapshot" :: held 2.333s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:17 devstack cinder-volume[83910]: WARNING cinder.quota [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Created reservations ['f762bd68-6023-45ab-8179-c7558dec38b0', '63d89726-8138-4ab2-ae0d-c3ada065fab4', 'dc0ce51c-e3eb-4019-a2b9-62ddbad573dc', 'abe34798-345b-46d2-94ca-614598e0a5ee'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Delete snapshot completed successfully.
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-15e2bc17-9095-4a39-883f-7fea0748658f tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-2e4b474d-0a18-4267-85f7-3c42f0ef1151-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:17 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.info" returned: 0 in 0.503s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e13d7518-7053-4de3-962c-e8ef91f32838,created_at=2026-02-27T00:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111529372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e13d7518-7053-4de3-962c-e8ef91f32838,host='devstack@QuobyteHD#QuobyteHD',id=5ea312c4-fea5-43e0-a76a-4f8cf9c9e591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3644467e2d84aa0b59d4fab1bd68b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:16Z,use_quota=True,user_id='237e4a13675a48f8a0dd6ef5af73a58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b369084-80e0-49a3-92e4-e8e5108599ba),volume_type_id=8b369084-80e0-49a3-92e4-e8e5108599ba)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Creating volume 5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:17 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:17 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 1073741824
Feb 27 01:25:17 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-fe751954-1bc7-4daa-ba8c-b7d599566f8d tempest-SnapshotMetadataTestJSON-606873473 None] Create snapshot completed successfully
Feb 27 01:25:18 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb" returned: 0 in 0.524s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb
Feb 27 01:25:18 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:18 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 1073741824" returned: 0 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591
Feb 27 01:25:18 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:18 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-703a8310-e981-43f1-b85d-c8542415dddb" returned: 0 in 0.584s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Lock "cinder-quobyte-703a8310-e981-43f1-b85d-c8542415dddb" released by "delete_volume" :: held 1.133s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Created reservations ['e76165f2-4491-4b62-9851-1e19500ebd56', '18fc15a0-b0c1-4d33-a55b-9fedfafb929d', '001eedb6-9592-4884-b0e9-47450c2f3f06', '4326f817-0fda-4247-a7af-a25cc02c9ad1'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:18 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "cinder-b09ed11d-e7be-4d61-b67a-358d0efa327f-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-b09ed11d-e7be-4d61-b67a-358d0efa327f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "cinder-quobyte-e1a5e1ac-2a96-4ae7-a3de-597998394c86" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-quobyte-e1a5e1ac-2a96-4ae7-a3de-597998394c86" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "cinder-quobyte-b09ed11d-e7be-4d61-b67a-358d0efa327f" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-quobyte-b09ed11d-e7be-4d61-b67a-358d0efa327f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Deleting offline snapshot b09ed11d-e7be-4d61-b67a-358d0efa327f of volume e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] snapshot_file for this snap is: volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed77a7b-b614-4701-9fac-67fff1755170]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f
Feb 27 01:25:18 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:19 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" returned: 0 in 0.570s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.215s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900a5a22-12d8-409c-a50a-2c4b10189656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281dd980-1e74-44dd-b1c1-9629651df9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:19 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Volume volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 (5ea312c4-fea5-43e0-a76a-4f8cf9c9e591): created successfully
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281dd980-1e74-44dd-b1c1-9629651df9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Flow 'volume_create_manager' (17ee8ecd-33bb-488b-ac72-a3d570700147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Creating offline snapshot 164603ed-4ea6-4d04-9b25-b3a6d70cdda3 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9c5c4c19-3556-46c1-9d01-dc76dd813132 tempest-GroupSnapshotsV319Test-2103883969 None] Created volume successfully.
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8c867-908d-4277-bed9-5eb4b413606f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:19 devstack sudo[86273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:19 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:19 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.539s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Deleted volume successfully.
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2136590c-362a-4f0e-bbc6-599321d61f56 tempest-DeleteServersTestJSON-1336671576 None] Lock "cinder-703a8310-e981-43f1-b85d-c8542415dddb-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:19 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f" returned: 0 in 0.556s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd84e4b-36ee-43d7-9c57-7256e258c65f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:19 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86
Feb 27 01:25:19 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] GroupSnapshot de8e95bc-e6e4-495c-903a-b36543c5f1e4: creating.
Feb 27 01:25:19 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.640s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Group snapshot de8e95bc-e6e4-495c-903a-b36543c5f1e4: creating. {{(pid=83910) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:25:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:19 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 1G
Feb 27 01:25:19 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:20 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86" returned: 0 in 0.662s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:20 devstack sudo[86289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f
Feb 27 01:25:20 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:20 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 1G" returned: 0 in 0.648s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:20 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3
Feb 27 01:25:20 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:20 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f" returned: 0 in 0.591s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:20 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f
Feb 27 01:25:20 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:21 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3" returned: 0 in 0.646s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:21 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 is being set with open permissions: ugo+rw
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:21 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3
Feb 27 01:25:21 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:21 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86.b09ed11d-e7be-4d61-b67a-358d0efa327f" returned: 0 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-quobyte-b09ed11d-e7be-4d61-b67a-358d0efa327f" released by "_delete_snapshot" :: held 2.531s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-quobyte-e1a5e1ac-2a96-4ae7-a3de-597998394c86" released by "delete_snapshot" :: held 2.549s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Created reservations ['fb93254d-9eef-40a9-8320-cb7baaaa4b2b', '99df7b85-c48b-4f62-98c7-1a346c33c8d4', 'b8eca825-f795-44c8-8d69-187b10a89ca3', 'ad53b93f-779c-451d-9180-75edfe0c556e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:21 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Delete snapshot completed successfully.
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-128a3423-4def-4a05-bea0-08c5e4136ffd tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-b09ed11d-e7be-4d61-b67a-358d0efa327f-delete_snapshot" released by "delete_snapshot" :: held 2.650s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:21 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.809s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Creating offline snapshot e76bc93a-9158-4785-a494-aabb85aead92 of volume 5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:21 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-7830f19e-0459-4a6c-a536-2ff39f7b317a tempest-SnapshotsActionsTest-468003378 None] Create snapshot completed successfully
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1742554a-235d-4655-a761-e115c1fb6d72]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:21 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591
Feb 27 01:25:21 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-164603ed-4ea6-4d04-9b25-b3a6d70cdda3-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "cinder-e1a5e1ac-2a96-4ae7-a3de-597998394c86-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-164603ed-4ea6-4d04-9b25-b3a6d70cdda3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-e1a5e1ac-2a96-4ae7-a3de-597998394c86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-164603ed-4ea6-4d04-9b25-b3a6d70cdda3" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-164603ed-4ea6-4d04-9b25-b3a6d70cdda3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Deleting offline snapshot 164603ed-4ea6-4d04-9b25-b3a6d70cdda3 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] snapshot_file for this snap is: volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "cinder-quobyte-e1a5e1ac-2a96-4ae7-a3de-597998394c86" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cbba80-019b-413a-87d3-e73f9c89fdeb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-quobyte-e1a5e1ac-2a96-4ae7-a3de-597998394c86" acquired by "delete_volume" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fead0e57-0b6d-4a61-817b-b4093e8c8314]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3
Feb 27 01:25:22 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" returned: 0 in 0.657s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86
Feb 27 01:25:22 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 1G
Feb 27 01:25:22 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3" returned: 0 in 0.612s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f572a08-4c66-4ee1-ba91-7e97226e62f8]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86" returned: 0 in 0.603s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86
Feb 27 01:25:22 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[86329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:22 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 1G" returned: 0 in 0.652s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92
Feb 27 01:25:22 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e1a5e1ac-2a96-4ae7-a3de-597998394c86" returned: 0 in 0.589s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-quobyte-e1a5e1ac-2a96-4ae7-a3de-597998394c86" released by "delete_volume" :: held 1.227s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Created reservations ['baa30528-0d27-4bec-b7b1-1b58b0b7745e', '2038c8da-8e99-4aba-b4ff-116fb19d0931', '7536daa1-8d5d-42e0-892c-4b8e94c89441', 'fdbec7a2-67f5-4df5-bce8-0002f962f577'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:23 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.699s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[86343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3
Feb 27 01:25:23 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[86345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:23 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92" returned: 0 in 0.684s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:25:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[86347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92
Feb 27 01:25:23 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:24 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Deleted volume successfully.
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b021b87f-265e-432d-85ae-7bc6a567bbec tempest-SnapshotMetadataTestJSON-606873473 None] Lock "cinder-e1a5e1ac-2a96-4ae7-a3de-597998394c86-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:24 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92" returned: 0 in 0.499s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:24 devstack sudo[86354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info
Feb 27 01:25:24 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:24 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3" returned: 0 in 0.683s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:24 devstack sudo[86356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3
Feb 27 01:25:24 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:24 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:24 devstack sudo[86359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info
Feb 27 01:25:24 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:24 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.164603ed-4ea6-4d04-9b25-b3a6d70cdda3" returned: 0 in 0.498s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-164603ed-4ea6-4d04-9b25-b3a6d70cdda3" released by "_delete_snapshot" :: held 2.566s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" released by "delete_snapshot" :: held 2.586s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Created reservations ['ba405bf3-8645-482d-a996-b29bbd6f4dc0', '60395c2c-e150-4d98-ab65-d8c836663357', 'cee9454c-c544-4cee-aea6-c1f6645f6b17', '3a039f21-1762-4c0f-8d2c-aca201d27dad'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Delete snapshot completed successfully.
Feb 27 01:25:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-28e48ace-10a3-45ee-a2df-d315d1807eb1 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-164603ed-4ea6-4d04-9b25-b3a6d70cdda3-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:25 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.info" returned: 0 in 0.561s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.531s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:25 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-18a2e09c-4f85-4458-a512-28e98444e858 tempest-GroupSnapshotsV319Test-2103883969 None] group_snapshot de8e95bc-e6e4-495c-903a-b36543c5f1e4: created successfully
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Creating offline snapshot 1a9e3a40-ce37-471f-a2e2-4760e0c69989 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91245e-414a-4015-9fdb-c619ec6b09e7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:25 devstack sudo[86363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:25 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.761s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack sudo[86368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 1G
Feb 27 01:25:26 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] group_snapshot de8e95bc-e6e4-495c-903a-b36543c5f1e4: deleting
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] group_snapshot de8e95bc-e6e4-495c-903a-b36543c5f1e4: deleting {{(pid=83910) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "cinder-quobyte-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "cinder-quobyte-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "cinder-quobyte-e76bc93a-9158-4785-a494-aabb85aead92" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "cinder-quobyte-e76bc93a-9158-4785-a494-aabb85aead92" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Deleting offline snapshot e76bc93a-9158-4785-a494-aabb85aead92 of volume 5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] snapshot_file for this snap is: volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e93069-923d-4635-b82f-eb2bcd59dc2e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92
Feb 27 01:25:26 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 1G" returned: 0 in 0.795s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[86375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989
Feb 27 01:25:27 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92" returned: 0 in 0.687s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[382fbf40-e96d-4d5b-8587-6157ad87cc5f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[86380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591
Feb 27 01:25:27 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989" returned: 0 in 0.679s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 is being set with open permissions: ugo+rw
Feb 27 01:25:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989
Feb 27 01:25:27 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:28 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" returned: 0 in 0.809s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:28 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92
Feb 27 01:25:28 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:28 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989" returned: 0 in 0.581s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.889s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-00d7956f-141f-4fec-8087-d01623d97c7a tempest-SnapshotsActionsTest-468003378 None] Create snapshot completed successfully
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-1a9e3a40-ce37-471f-a2e2-4760e0c69989-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92" returned: 0 in 0.677s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-1a9e3a40-ce37-471f-a2e2-4760e0c69989-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-1a9e3a40-ce37-471f-a2e2-4760e0c69989" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-1a9e3a40-ce37-471f-a2e2-4760e0c69989" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92
Feb 27 01:25:28 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Deleting offline snapshot 1a9e3a40-ce37-471f-a2e2-4760e0c69989 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] snapshot_file for this snap is: volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb857e-3b1f-459d-8252-c13519abff4e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:29 devstack sudo[86399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989
Feb 27 01:25:29 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Flow 'volume_create_manager' (bc9566bc-9dda-4c04-a68e-d5469a62532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e3eab3-dabe-4213-a2b7-955f7899d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e3eab3-dabe-4213-a2b7-955f7899d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530602803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd5ef59-2478-45c8-b721-c193fb8a210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b67249a03b045c19b3a07c4d7693679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:29Z,use_quota=True,user_id='d33a2879fb4044fb8f60ff5a77d3be97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8359022a-e3f1-4b6b-b3a2-7c890af3f652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8359022a-e3f1-4b6b-b3a2-7c890af3f652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b733e7-851d-4551-8e7c-03e455f2a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.image.glance [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Creating Keystone auth plugin from conf {{(pid=83910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:25:29 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591.e76bc93a-9158-4785-a494-aabb85aead92" returned: 0 in 0.595s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "cinder-quobyte-e76bc93a-9158-4785-a494-aabb85aead92" released by "_delete_snapshot" :: held 2.845s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Lock "cinder-quobyte-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" released by "delete_snapshot" :: held 2.870s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:29 devstack cinder-volume[83910]: WARNING cinder.quota [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1824841306 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1824841306, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:29 devstack cinder-volume[83910]: WARNING cinder.quota [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1824841306 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1824841306, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:29 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989" returned: 0 in 0.645s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e92d2bf-c12f-437d-8c13-b064e8e2a29d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] Created reservations ['f605a7d4-e199-46eb-b42b-2842a1fa1d81', '8c0a33b5-7b7b-42d6-a02a-a46f123f2149', '5bccdaf2-45ed-4b43-bc50-c4bf34701b07', 'b152d09f-2e0a-41ca-a340-e8ffd3e73cfe'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:29 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f52f5696-7996-4d6f-8ee2-6994694e6cb1 tempest-GroupSnapshotsV319Test-2103883969 None] group_snapshot de8e95bc-e6e4-495c-903a-b36543c5f1e4: deleted successfully
Feb 27 01:25:29 devstack sudo[86405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:29 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b733e7-851d-4551-8e7c-03e455f2a195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7bd5ef59-2478-45c8-b721-c193fb8a210f', 'volume_name': 'volume-7bd5ef59-2478-45c8-b721-c193fb8a210f', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ad9acf7f0>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac85fad-045c-4a7a-871c-3ef1aeda1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac85fad-045c-4a7a-871c-3ef1aeda1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e28eada-d49d-44b2-bd82-8361663464eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:29 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Volume 7bd5ef59-2478-45c8-b721-c193fb8a210f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7bd5ef59-2478-45c8-b721-c193fb8a210f', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ad9acf7f0>}
Feb 27 01:25:29 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Trying to clone 7bd5ef59-2478-45c8-b721-c193fb8a210f from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]). {{(pid=83910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:25:30 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "cinder-quobyte-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Lock "cinder-quobyte-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0881a1-c3b8-4a1e-8ef3-5a8cebb7745e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b121a690-9821-4b7d-a10c-6ee3b9eb8607]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD
Feb 27 01:25:30 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack sudo[86428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591
Feb 27 01:25:30 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.771s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[86435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989
Feb 27 01:25:30 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[86446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:30 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 is fetched for user d33a2879fb4044fb8f60ff5a77d3be97. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:25:30 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" returned: 0 in 0.683s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[86448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591
Feb 27 01:25:30 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f689bed-9e0e-4884-a82c-dcf22ef9c624]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989" returned: 0 in 0.594s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:31 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989
Feb 27 01:25:31 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:31 devstack sudo[86450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD
Feb 27 01:25:31 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:31 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.1a9e3a40-ce37-471f-a2e2-4760e0c69989" returned: 0 in 0.610s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-1a9e3a40-ce37-471f-a2e2-4760e0c69989" released by "_delete_snapshot" :: held 2.753s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" released by "delete_snapshot" :: held 2.777s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:31 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:UPDATE=161,cinder:SELECT=171,cinder:DELETE=16,cinder:INSERT=40 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.882s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=173,cinder:UPDATE=195,cinder:INSERT=47,cinder:DELETE=6 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:25:31 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" returned: 0 in 0.831s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Lock "cinder-quobyte-5ea312c4-fea5-43e0-a76a-4f8cf9c9e591" released by "delete_volume" :: held 1.557s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Created reservations ['6cf22c3b-014d-4e29-8e05-cc2973803714', 'fbdc551a-3309-416e-a923-bc115e307e61', 'c0047838-e09a-4ea4-ba2a-70fe9aa638df', '59394d02-9d03-4262-966a-cfa49866f0d9'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Created reservations ['b293768f-e071-4216-be94-671ffd66d1ee'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:31 devstack cinder-volume[83910]: WARNING cinder.quota [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1824841306 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1824841306, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:31 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Delete snapshot completed successfully.
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-742e54c9-2a74-4a97-8690-d799778ff038 tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-1a9e3a40-ce37-471f-a2e2-4760e0c69989-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Created reservations ['30662e91-c774-4771-815b-f4ee5f09f4c9', 'b63a1053-4790-4902-aa0f-208322532833', 'cf5c85b5-ff33-42cc-bd96-ea72e4e21265', '0b614a21-85cb-4fb0-8639-dbe63704fa14'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:31 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD" returned: 0 in 0.941s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530602803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd5ef59-2478-45c8-b721-c193fb8a210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b67249a03b045c19b3a07c4d7693679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:29Z,use_quota=True,user_id='d33a2879fb4044fb8f60ff5a77d3be97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Creating volume 7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:31 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:31 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 1073741824
Feb 27 01:25:31 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:32 devstack sudo[86462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:32 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:32 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 1073741824" returned: 0 in 0.792s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:32 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.692s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:32 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a838fa3d-ee9b-4eb9-8a53-d393ef7be4aa tempest-GroupSnapshotsV319Test-2103883969 None] Delete group completed successfully.
Feb 27 01:25:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:32 devstack sudo[86468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:32 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:33 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 0 in 0.535s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.969s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Creating offline snapshot 98cf22ad-82f8-4ee7-9c76-26adc5d7c701 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Attempting download of 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 7bd5ef59-2478-45c8-b721-c193fb8a210f. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2a298-2602-4224-89b1-6f61df7c559c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3c1adf-08e9-4bf3-a7dc-2090ab4e2a7a]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:33 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:33 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:33 devstack sudo[86472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46
Feb 27 01:25:33 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:34 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46" returned: 0 in 0.625s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:34 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.741s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:34 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46
Feb 27 01:25:34 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:34 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 1G
Feb 27 01:25:34 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:34 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46" returned: 1 in 0.664s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_hux75q46' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9490ab7c-6aa7-4df4-92ec-cc939f9d0e2c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:34 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 1G" returned: 0 in 0.660s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:34 devstack sudo[86491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD
Feb 27 01:25:34 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:34 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701
Feb 27 01:25:34 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:35 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:35 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 was qcow2, converting to raw {{(pid=83910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:25:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:35 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:35 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:35 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701" returned: 0 in 0.732s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:35 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 is being set with open permissions: ugo+rw
Feb 27 01:25:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:35 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701
Feb 27 01:25:35 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:36 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701" returned: 0 in 0.654s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:36 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-03c2e543-826d-4406-b438-e76b837e6680 tempest-SnapshotsActionsTest-468003378 None] Create snapshot completed successfully
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-98cf22ad-82f8-4ee7-9c76-26adc5d7c701-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-98cf22ad-82f8-4ee7-9c76-26adc5d7c701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Acquiring lock "cinder-quobyte-98cf22ad-82f8-4ee7-9c76-26adc5d7c701" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-98cf22ad-82f8-4ee7-9c76-26adc5d7c701" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Deleting offline snapshot 98cf22ad-82f8-4ee7-9c76-26adc5d7c701 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] snapshot_file for this snap is: volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5043aa89-e34f-4324-9c53-6e32c86e625d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:36 devstack sudo[86513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701
Feb 27 01:25:36 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:36 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 0 in 1.547s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_a5ekhfuadevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:25:36 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Converted 112.00 MB image at 72.35 MB/s
Feb 27 01:25:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:36 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 1G
Feb 27 01:25:36 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:37 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701" returned: 0 in 0.684s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd081b7c-b7bd-4145-88f6-5ba3551e12c3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:37 devstack sudo[86523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:37 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:37 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 1G" returned: 0 in 0.655s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[312a66fe-f3af-4831-873c-8c506ef8d8f4]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:37 devstack sudo[86529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:37 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:38 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.636s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:38 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701
Feb 27 01:25:38 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:38 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 0 in 0.597s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:38 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:38 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:38 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701" returned: 0 in 0.676s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:38 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701
Feb 27 01:25:38 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:38 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 1 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Downloaded image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 7bd5ef59-2478-45c8-b721-c193fb8a210f successfully. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 for user d33a2879fb4044fb8f60ff5a77d3be97 is deleted. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Marking volume 7bd5ef59-2478-45c8-b721-c193fb8a210f as bootable. {{(pid=83910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Copying metadata from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 to 7bd5ef59-2478-45c8-b721-c193fb8a210f. {{(pid=83910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Creating volume glance metadata for volume 7bd5ef59-2478-45c8-b721-c193fb8a210f backed by image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e28eada-d49d-44b2-bd82-8361663464eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd5ef59-2478-45c8-b721-c193fb8a210f', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ad9acf7f0>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9262d4d4-6300-4ed2-923e-58922de4a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:38 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Volume volume-7bd5ef59-2478-45c8-b721-c193fb8a210f (7bd5ef59-2478-45c8-b721-c193fb8a210f): created successfully
Feb 27 01:25:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9262d4d4-6300-4ed2-923e-58922de4a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Flow 'volume_create_manager' (bc9566bc-9dda-4c04-a68e-d5469a62532e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-949da702-ccc6-4f68-b501-f0cf680ca8d7 tempest-VolumesExtendTest-1041404247 None] Created volume successfully.
Feb 27 01:25:39 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.98cf22ad-82f8-4ee7-9c76-26adc5d7c701" returned: 0 in 0.559s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-98cf22ad-82f8-4ee7-9c76-26adc5d7c701" released by "_delete_snapshot" :: held 2.616s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" released by "delete_snapshot" :: held 2.640s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:39 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Created reservations ['2b09276c-45e4-4295-9450-5d13df37dced', '9c550fc6-2403-4eda-bd1d-7adea69650bf', '6d81cdd6-73fe-4448-b79f-feeef95c90bd', '209e1a66-52d2-41e0-9b9c-a6f13dbf72ae'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Delete snapshot completed successfully.
Feb 27 01:25:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-defcf37e-686d-4816-9b8a-ba616af40abd tempest-SnapshotsActionsTest-1574240761 None] Lock "cinder-98cf22ad-82f8-4ee7-9c76-26adc5d7c701-delete_snapshot" released by "delete_snapshot" :: held 2.815s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "cinder-d8f94499-5882-4309-93af-10e40fd64a63-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-d8f94499-5882-4309-93af-10e40fd64a63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "cinder-quobyte-d8f94499-5882-4309-93af-10e40fd64a63" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-quobyte-d8f94499-5882-4309-93af-10e40fd64a63" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Deleting offline snapshot d8f94499-5882-4309-93af-10e40fd64a63 of volume e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] snapshot_file for this snap is: volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a7f6b-7305-449f-8100-43a8744c0257]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f60cc9-e3fc-48a1-b4e4-6b4be4bb59a1]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:40 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:40 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:40 devstack sudo[86550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:40 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:40 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 0 in 0.537s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:40 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.609s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e656b7f7-9949-4aed-a3cc-077076305948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90179b-8c54-4efd-b9da-ce305180b206]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:40 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:40 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:40 devstack sudo[86559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948
Feb 27 01:25:40 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:41 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 1 in 0.632s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 2G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f 2G" returned: 0 in 0.057s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.261s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:41 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948" returned: 0 in 0.703s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-94bcbf0f-4359-4749-9d25-32e084d7cc61 tempest-VolumesExtendTest-1041404247 None] Extend volume completed successfully.
Feb 27 01:25:41 devstack sudo[86577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:41 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-441c2292-111c-448d-a5d6-a2036a4df615 tempest-GroupsV320Test-715481827 None] Group tempest-GroupsV320Test-Group-1375825058: creating
Feb 27 01:25:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-441c2292-111c-448d-a5d6-a2036a4df615 tempest-GroupsV320Test-715481827 None] Group tempest-GroupsV320Test-Group-1375825058: created successfully
Feb 27 01:25:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-441c2292-111c-448d-a5d6-a2036a4df615 tempest-GroupsV320Test-715481827 None] Create group completed successfully.
Feb 27 01:25:42 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:42 devstack sudo[86582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63
Feb 27 01:25:42 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-7bd5ef59-2478-45c8-b721-c193fb8a210f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-7bd5ef59-2478-45c8-b721-c193fb8a210f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-quobyte-7bd5ef59-2478-45c8-b721-c193fb8a210f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-7bd5ef59-2478-45c8-b721-c193fb8a210f" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0678e4b-2800-472c-a2dd-037922e9cdb0]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:42 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948.d8f94499-5882-4309-93af-10e40fd64a63" returned: 0 in 0.527s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-quobyte-d8f94499-5882-4309-93af-10e40fd64a63" released by "_delete_snapshot" :: held 2.582s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" released by "delete_snapshot" :: held 2.597s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:42 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:42 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Created reservations ['c634fc94-1219-4905-b810-0d0cbe9e57ca', '2cea90cf-602a-4d83-bece-f731d1367e0a', '50d15772-85d5-4c35-982a-d610b1092e9f', '22698cbb-f389-49fa-8172-d0bb398727f9'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Delete snapshot completed successfully.
Feb 27 01:25:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db2272af-c1e1-4de4-9b68-a5647f82f256 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-d8f94499-5882-4309-93af-10e40fd64a63-delete_snapshot" released by "delete_snapshot" :: held 2.806s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:43 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 0 in 0.840s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "cinder-e656b7f7-9949-4aed-a3cc-077076305948-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Created reservations ['33435cee-f1cb-4c79-a5ad-748b2de2e94f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-e656b7f7-9949-4aed-a3cc-077076305948-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:43 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:43 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a434c7-ad01-4647-bac2-12e574279379]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:43 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:43 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:43 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948
Feb 27 01:25:43 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.562s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:44 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b4e8a776-861f-4103-a000-ea4b3df3203b tempest-GroupsV320Test-715481827 None] Delete group completed successfully.
Feb 27 01:25:44 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 1 in 0.788s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f
Feb 27 01:25:44 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948" returned: 0 in 0.732s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948
Feb 27 01:25:44 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7bd5ef59-2478-45c8-b721-c193fb8a210f" returned: 0 in 0.503s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-7bd5ef59-2478-45c8-b721-c193fb8a210f" released by "delete_volume" :: held 2.199s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Created reservations ['8a692a2d-5044-40b4-b733-e8879af1d2c9', 'dc252ba5-5f56-44df-90f2-a33a1c5684f0', '99ff0a2a-d49c-48a4-a54e-ad619d20e285', '1534dab6-e2be-4698-8fd7-71744eb522ff'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:44 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e656b7f7-9949-4aed-a3cc-077076305948" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-quobyte-e656b7f7-9949-4aed-a3cc-077076305948" released by "delete_volume" :: held 1.288s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Created reservations ['0bcb427d-fae5-4add-b40b-99a717fc329c', 'f15952c2-0545-4d4d-b702-58d18792207d', 'b092e0fd-8cdd-40db-a3d5-b26294003292', '68d76ccf-0bb7-4cec-9ce3-b674458c2ade'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:44 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:44 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:45 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:45 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:45 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.653s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Deleted volume successfully.
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9349160c-6c35-4be1-9ff6-8bbb25db3e87 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-7bd5ef59-2478-45c8-b721-c193fb8a210f-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:45 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.727s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Deleted volume successfully.
Feb 27 01:25:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8656337c-701e-4ddd-bd4e-56e6708aeaf0 tempest-SnapshotsActionsTest-468003378 None] Lock "cinder-e656b7f7-9949-4aed-a3cc-077076305948-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Flow 'volume_create_manager' (80c5b261-308a-4170-9e8f-324f9661b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc944a75-e6dd-4690-a94d-479431808e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc944a75-e6dd-4690-a94d-479431808e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1075765509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9fe8ec-aebf-4505-8473-8dacb3b40c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b67249a03b045c19b3a07c4d7693679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:46Z,use_quota=True,user_id='d33a2879fb4044fb8f60ff5a77d3be97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a7ecc4-b19c-4e8b-ab8e-4d4ac7b2550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a7ecc4-b19c-4e8b-ab8e-4d4ac7b2550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ca60c-ccb2-4018-8d42-ec9b294451cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ca60c-ccb2-4018-8d42-ec9b294451cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9fe8ec-aebf-4505-8473-8dacb3b40c8f', 'volume_name': 'volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51460627-2527-4fd5-b6e5-d6aaeeadf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51460627-2527-4fd5-b6e5-d6aaeeadf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9cda07-aa4c-4380-921b-5017e33557a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:46 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Volume bd9fe8ec-aebf-4505-8473-8dacb3b40c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f', 'volume_size': 1}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1075765509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9fe8ec-aebf-4505-8473-8dacb3b40c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b67249a03b045c19b3a07c4d7693679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:46Z,use_quota=True,user_id='d33a2879fb4044fb8f60ff5a77d3be97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Creating volume bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:46 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:46 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f 1073741824
Feb 27 01:25:46 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:47 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f 1073741824" returned: 0 in 0.762s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:47 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f
Feb 27 01:25:47 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:47 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" returned: 0 in 0.573s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9cda07-aa4c-4380-921b-5017e33557a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcc34f2-fc79-4e0a-9390-599db7ae9a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:47 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Volume volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f (bd9fe8ec-aebf-4505-8473-8dacb3b40c8f): created successfully
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcc34f2-fc79-4e0a-9390-599db7ae9a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Flow 'volume_create_manager' (80c5b261-308a-4170-9e8f-324f9661b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:47 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e76d74d4-a549-4b1c-bb42-9cb53fc6ad86 tempest-VolumesExtendTest-1041404247 None] Created volume successfully.
Feb 27 01:25:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Creating offline snapshot 8655dc2d-1f95-43e5-a603-864bd1e7e17c of volume bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957781a-92a0-422c-b1e4-a925cbdc4c66]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:48 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f
Feb 27 01:25:48 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:49 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" returned: 0 in 0.771s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:49 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c 1G
Feb 27 01:25:49 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:50 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c 1G" returned: 0 in 0.669s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack sudo[86714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c
Feb 27 01:25:50 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:50 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c" returned: 0 in 0.736s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:50 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c is being set with open permissions: ugo+rw
Feb 27 01:25:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c
Feb 27 01:25:50 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:51 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Flow 'volume_create_manager' (4c601dc3-b0b1-4539-97fa-23f29510611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d614cda1-96ea-435a-8bc7-21ebd3327a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c" returned: 0 in 0.718s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d614cda1-96ea-435a-8bc7-21ebd3327a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1990293572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73083fc-c02c-43d2-aebc-9974fadd7351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86199946abbb439a809435cdea459335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:51Z,use_quota=True,user_id='b38550721e674951953652f572ead7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa63b26e-129d-4f9a-9ce9-3ab43e64b20c),volume_type_id=fa63b26e-129d-4f9a-9ce9-3ab43e64b20c)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa9ded5-ad59-4b6f-ad04-a8f19c40b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa9ded5-ad59-4b6f-ad04-a8f19c40b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c817fe20-8d63-40e8-b611-4eadc3ba1838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c817fe20-8d63-40e8-b611-4eadc3ba1838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73083fc-c02c-43d2-aebc-9974fadd7351', 'volume_name': 'volume-e73083fc-c02c-43d2-aebc-9974fadd7351', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de7b481-f1ee-4dce-ba1b-549482ea2ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de7b481-f1ee-4dce-ba1b-549482ea2ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9450539-510f-480a-a8b7-de8e05ef9e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Volume e73083fc-c02c-43d2-aebc-9974fadd7351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73083fc-c02c-43d2-aebc-9974fadd7351', 'volume_size': 1}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:51 devstack sudo[86723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info
Feb 27 01:25:51 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:52 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info" returned: 0 in 0.661s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:52 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info is being set with open permissions: ugo+rw
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:52 devstack sudo[86726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info
Feb 27 01:25:52 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:52 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.info" returned: 0 in 0.510s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.246s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1990293572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73083fc-c02c-43d2-aebc-9974fadd7351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86199946abbb439a809435cdea459335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:51Z,use_quota=True,user_id='b38550721e674951953652f572ead7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa63b26e-129d-4f9a-9ce9-3ab43e64b20c),volume_type_id=fa63b26e-129d-4f9a-9ce9-3ab43e64b20c)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Creating volume e73083fc-c02c-43d2-aebc-9974fadd7351 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:52 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:52 devstack sudo[86729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351 1073741824
Feb 27 01:25:52 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c216ea73-c3d2-4afd-905e-bc8fff658e04 tempest-VolumesExtendTest-1041404247 None] Create snapshot completed successfully
Feb 27 01:25:53 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351 1073741824" returned: 0 in 0.726s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:53 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351
Feb 27 01:25:53 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:54 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351" returned: 0 in 0.544s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.245s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9450539-510f-480a-a8b7-de8e05ef9e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73083fc-c02c-43d2-aebc-9974fadd7351', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bd3978-5f6d-4060-9a0a-6107f25c09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3e896-bab4-4855-83ea-9ece211b2e6d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:54 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Volume volume-e73083fc-c02c-43d2-aebc-9974fadd7351 (e73083fc-c02c-43d2-aebc-9974fadd7351): created successfully
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bd3978-5f6d-4060-9a0a-6107f25c09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Flow 'volume_create_manager' (4c601dc3-b0b1-4539-97fa-23f29510611b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:54 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4693edef-efa5-4549-a5d6-84d20208c2fa tempest-VolumeTypesAccessTest-201031306 None] Created volume successfully.
Feb 27 01:25:54 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f
Feb 27 01:25:54 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Acquiring lock "cinder-e73083fc-c02c-43d2-aebc-9974fadd7351-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Lock "cinder-e73083fc-c02c-43d2-aebc-9974fadd7351-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:54 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" returned: 0 in 0.682s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c 2G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Acquiring lock "cinder-quobyte-e73083fc-c02c-43d2-aebc-9974fadd7351" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Lock "cinder-quobyte-e73083fc-c02c-43d2-aebc-9974fadd7351" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b3553e-3baa-4211-815e-3f277cf6295c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:55 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351
Feb 27 01:25:55 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c 2G" returned: 0 in 0.198s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.925s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4b598097-028c-415c-b527-554e7eaed48d tempest-VolumesExtendTest-1041404247 None] Extend volume completed successfully.
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Flow 'volume_create_manager' (216ce880-e1de-4256-87fd-6150738ad689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb6e866-f676-4abb-8f8e-bce4fda524c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb6e866-f676-4abb-8f8e-bce4fda524c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-448666934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3795f1d-c193-4dab-ae0f-f6d717a33230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47949d66ad94bde907833eee72b1bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:55Z,use_quota=True,user_id='88eb34108e7046ada965934c42041e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a087a66b-ee04-4bc5-84a8-3a16ca04500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a087a66b-ee04-4bc5-84a8-3a16ca04500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e389b74-0b5b-4691-a747-79791872ed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e389b74-0b5b-4691-a747-79791872ed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3795f1d-c193-4dab-ae0f-f6d717a33230', 'volume_name': 'volume-e3795f1d-c193-4dab-ae0f-f6d717a33230', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10aec96-defd-48fb-b4fe-c65fbd753349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10aec96-defd-48fb-b4fe-c65fbd753349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e369d1b2-7390-4d1a-9cc9-af5ce70ce676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Volume e3795f1d-c193-4dab-ae0f-f6d717a33230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3795f1d-c193-4dab-ae0f-f6d717a33230', 'volume_size': 1}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-448666934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3795f1d-c193-4dab-ae0f-f6d717a33230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47949d66ad94bde907833eee72b1bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:55Z,use_quota=True,user_id='88eb34108e7046ada965934c42041e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Creating volume e3795f1d-c193-4dab-ae0f-f6d717a33230 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:55 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:55 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 1073741824
Feb 27 01:25:55 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:55 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351" returned: 0 in 0.606s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:55 devstack sudo[86756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351
Feb 27 01:25:55 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:55 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 1073741824" returned: 0 in 0.547s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:55 devstack sudo[86779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230
Feb 27 01:25:55 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:56 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e73083fc-c02c-43d2-aebc-9974fadd7351" returned: 0 in 0.527s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Lock "cinder-quobyte-e73083fc-c02c-43d2-aebc-9974fadd7351" released by "delete_volume" :: held 1.162s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:56 devstack cinder-volume[83910]: WARNING cinder.quota [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1084056240 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1084056240, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:56 devstack cinder-volume[83910]: WARNING cinder.quota [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1084056240 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1084056240, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Created reservations ['7d591873-4e57-45b0-a7af-c6f16b00b24a', '7f5e7832-da81-468f-8a5a-fa55a5ab07fc', 'e4449764-bbed-4e5c-a1b4-eaafd3121f22', '164ebe84-4056-4dd5-b11f-462663ff44cc'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:56 devstack sudo[86785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:56 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-8655dc2d-1f95-43e5-a603-864bd1e7e17c-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-8655dc2d-1f95-43e5-a603-864bd1e7e17c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-quobyte-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-quobyte-8655dc2d-1f95-43e5-a603-864bd1e7e17c" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-8655dc2d-1f95-43e5-a603-864bd1e7e17c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Deleting offline snapshot 8655dc2d-1f95-43e5-a603-864bd1e7e17c of volume bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] snapshot_file for this snap is: volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b020da-b18c-4502-b9a5-ac3499287512]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:56 devstack sudo[86787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c
Feb 27 01:25:56 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:56 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230" returned: 0 in 0.562s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e369d1b2-7390-4d1a-9cc9-af5ce70ce676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3795f1d-c193-4dab-ae0f-f6d717a33230', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff146051-929d-4f90-b2b5-35e5c82aecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Volume volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 (e3795f1d-c193-4dab-ae0f-f6d717a33230): created successfully
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff146051-929d-4f90-b2b5-35e5c82aecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Flow 'volume_create_manager' (216ce880-e1de-4256-87fd-6150738ad689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d0fd2bc5-0280-402e-bb54-b2f000e817df tempest-VolumeQuotasAdminTestJSON-2099336279 None] Created volume successfully.
Feb 27 01:25:56 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.500s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Deleted volume successfully.
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4bdc1b7a-72c8-478f-b8b9-c7e38ad36759 tempest-VolumeTypesAccessTest-201031306 None] Lock "cinder-e73083fc-c02c-43d2-aebc-9974fadd7351-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:56 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c" returned: 0 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04c160-b5a2-4cb1-9bde-d561fc340bdd]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:57 devstack sudo[86794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f
Feb 27 01:25:57 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "cinder-e3795f1d-c193-4dab-ae0f-f6d717a33230-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "cinder-e3795f1d-c193-4dab-ae0f-f6d717a33230-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "cinder-quobyte-e3795f1d-c193-4dab-ae0f-f6d717a33230" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "cinder-quobyte-e3795f1d-c193-4dab-ae0f-f6d717a33230" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8741c8a3-3f78-465f-bae0-e900b6f0170d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:57 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" returned: 0 in 0.685s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:57 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230
Feb 27 01:25:57 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:57 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c
Feb 27 01:25:57 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:58 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230" returned: 0 in 0.846s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:58 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230
Feb 27 01:25:58 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:58 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c" returned: 0 in 0.928s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:58 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c
Feb 27 01:25:58 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:59 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f.8655dc2d-1f95-43e5-a603-864bd1e7e17c" returned: 0 in 0.618s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:59 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3795f1d-c193-4dab-ae0f-f6d717a33230" returned: 0 in 0.794s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-8655dc2d-1f95-43e5-a603-864bd1e7e17c" released by "_delete_snapshot" :: held 2.961s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "cinder-quobyte-e3795f1d-c193-4dab-ae0f-f6d717a33230" released by "delete_volume" :: held 1.674s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" released by "delete_snapshot" :: held 2.993s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Created reservations ['ba37ff7f-1a2f-4a7f-81ba-1a23ea909491', '98993ae9-0cff-475b-951a-2b6212394dfd', '706a0a49-04fe-476c-a614-f7f02f2a2f60', 'cf0c8718-dfa2-4220-9b77-cd925ede486a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Created reservations ['4e908dc6-4091-4bb7-b5d5-acc9868a58e1', '49da06aa-4a44-48f3-b3a8-2d0b93530f21', '78c60786-b584-4a20-8b85-a8f63309342e', '3d5a621a-672c-4057-970e-cb17bf83e924'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:59 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Delete snapshot completed successfully.
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2dbe686b-25c5-4115-8628-38675ac425c5 tempest-VolumesExtendTest-1041404247 None] Lock "cinder-8655dc2d-1f95-43e5-a603-864bd1e7e17c-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:59 devstack sudo[86816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:25:59 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:00 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.802s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:00 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Deleted volume successfully.
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b759e6d4-67bb-4b19-a88f-ac8d6eb0ed05 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "cinder-e3795f1d-c193-4dab-ae0f-f6d717a33230-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Flow 'volume_create_manager' (d35d5d99-5d26-4065-a4ff-45b321c5483a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1eed8f8-5d10-4b42-a6ab-75b338c4856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1eed8f8-5d10-4b42-a6ab-75b338c4856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-545799869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df421a1a-8062-4d4b-ac54-83f9ff3ed9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47949d66ad94bde907833eee72b1bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:00Z,use_quota=True,user_id='88eb34108e7046ada965934c42041e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ef9ff9-e81c-44c8-802f-fc3ab4015746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ef9ff9-e81c-44c8-802f-fc3ab4015746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2bae5-dca7-42c8-85b7-dd6601a600ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2bae5-dca7-42c8-85b7-dd6601a600ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df421a1a-8062-4d4b-ac54-83f9ff3ed9db', 'volume_name': 'volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c44e4a-0fe4-40b5-9a76-54d8fe7f1199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c44e4a-0fe4-40b5-9a76-54d8fe7f1199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670f3910-3caa-48a3-bfd7-ee2bde959bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:00 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Volume df421a1a-8062-4d4b-ac54-83f9ff3ed9db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db', 'volume_size': 1}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-545799869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df421a1a-8062-4d4b-ac54-83f9ff3ed9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47949d66ad94bde907833eee72b1bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:00Z,use_quota=True,user_id='88eb34108e7046ada965934c42041e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Creating volume df421a1a-8062-4d4b-ac54-83f9ff3ed9db {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:00 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:00 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db 1073741824
Feb 27 01:26:00 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Lock "cinder-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Acquiring lock "cinder-quobyte-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" acquired by "delete_volume" :: waited 0.026s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522e32e-08a5-4520-8384-92fb84588079]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:01 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f
Feb 27 01:26:01 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:01 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db 1073741824" returned: 0 in 0.965s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:01 devstack sudo[86830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db
Feb 27 01:26:01 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:01 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" returned: 0 in 1.031s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:01 devstack sudo[86835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f
Feb 27 01:26:01 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:02 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db" returned: 0 in 0.772s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670f3910-3caa-48a3-bfd7-ee2bde959bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7034af-2079-4cae-993c-65259f2f16a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:02 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Volume volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db (df421a1a-8062-4d4b-ac54-83f9ff3ed9db): created successfully
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7034af-2079-4cae-993c-65259f2f16a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Flow 'volume_create_manager' (d35d5d99-5d26-4065-a4ff-45b321c5483a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:02 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6f7c61cd-ee80-4f13-892d-075a3c95b753 tempest-VolumeQuotasAdminTestJSON-2099336279 None] Created volume successfully.
Feb 27 01:26:02 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" returned: 0 in 0.651s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Lock "cinder-quobyte-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f" released by "delete_volume" :: held 1.747s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Created reservations ['452e30d4-e8f5-45d6-b576-68d09249a6dd', 'ac96baa4-1fb1-40b9-9cbf-f7c5e622b871', 'b048f3ba-fa10-44a9-8581-2e555a275232', '47f0ce94-5e99-4fc3-847b-9bfdd488600a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:02 devstack sudo[86839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:02 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:03 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.603s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:03 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Deleted volume successfully.
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fd77aba-0f78-476d-ac9c-cb730406051b tempest-VolumesExtendTest-1041404247 None] Lock "cinder-bd9fe8ec-aebf-4505-8473-8dacb3b40c8f-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:03 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c4a232a0-a3a4-4ccb-bb64-80e9e81b128c tempest-VolumeQuotasAdminTestJSON-1168399355 None] Transfer volume completed successfully.
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Flow 'volume_create_manager' (64da7d4f-3e17-4851-bdd4-bf4517eaeed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f321b5-ff6a-41fe-9ddd-3c0684d9d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f321b5-ff6a-41fe-9ddd-3c0684d9d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2110876969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3329a027-f5b0-443e-a763-45eb2c4b054f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31c13c888444078cd41741da02c927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:04Z,use_quota=True,user_id='7e3754bff5f348bdba6756d6a8e7b1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c2b1a6-6264-48de-847c-f0f37d6e940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c2b1a6-6264-48de-847c-f0f37d6e940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea983a7-ee46-4a98-bb16-115b1964008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:03 devstack cinder-volume[83910]: DEBUG cinder.image.glance [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Creating Keystone auth plugin from conf {{(pid=83910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea983a7-ee46-4a98-bb16-115b1964008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3329a027-f5b0-443e-a763-45eb2c4b054f', 'volume_name': 'volume-3329a027-f5b0-443e-a763-45eb2c4b054f', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ada504820>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a62362-9177-4276-9661-d5042d4cb8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a62362-9177-4276-9661-d5042d4cb8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18ef984-ae2c-4a04-a814-bf2d58fd77e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:04 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Volume 3329a027-f5b0-443e-a763-45eb2c4b054f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3329a027-f5b0-443e-a763-45eb2c4b054f', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ada504820>}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Trying to clone 3329a027-f5b0-443e-a763-45eb2c4b054f from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]). {{(pid=83910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:26:04 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Acquiring lock "cinder-df421a1a-8062-4d4b-ac54-83f9ff3ed9db-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Lock "cinder-df421a1a-8062-4d4b-ac54-83f9ff3ed9db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1acb83-96d8-4f97-984b-5ab0025c344f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Acquiring lock "cinder-quobyte-df421a1a-8062-4d4b-ac54-83f9ff3ed9db" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Lock "cinder-quobyte-df421a1a-8062-4d4b-ac54-83f9ff3ed9db" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:04 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD
Feb 27 01:26:04 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748d2f3-6d48-4076-9a67-79a813f8ad6b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:04 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db
Feb 27 01:26:04 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:05 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD" returned: 0 in 0.688s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 is fetched for user 7e3754bff5f348bdba6756d6a8e7b1ab. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390a9ce-fb74-493d-915b-20c3d822808b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:05 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD
Feb 27 01:26:05 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:05 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db" returned: 0 in 0.769s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:05 devstack sudo[86857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db
Feb 27 01:26:05 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Flow 'volume_create_manager' (dcd259b2-b65d-4221-95f7-6c7c2fc02a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9fe2f1-03a8-4aca-9060-dcced4c62e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9fe2f1-03a8-4aca-9060-dcced4c62e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1736145327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db07aca-b243-4ddf-8bda-d32fd00e7235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8235e4132b1445a8e574eb0f9101dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:06Z,use_quota=True,user_id='d6fb432ba61f409b86f69da8e2a543b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1622349e-2313-4f9a-88c0-2cd8a1edf257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1622349e-2313-4f9a-88c0-2cd8a1edf257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12e14cb-eedf-47e0-b550-b6f6c815e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12e14cb-eedf-47e0-b550-b6f6c815e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db07aca-b243-4ddf-8bda-d32fd00e7235', 'volume_name': 'volume-5db07aca-b243-4ddf-8bda-d32fd00e7235', 'volume_size': 2}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe9d769-7153-4240-933e-8538b05e4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe9d769-7153-4240-933e-8538b05e4e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e459cb2-65a3-4d04-affe-aa98964f8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Volume 5db07aca-b243-4ddf-8bda-d32fd00e7235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db07aca-b243-4ddf-8bda-d32fd00e7235', 'volume_size': 2}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1736145327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db07aca-b243-4ddf-8bda-d32fd00e7235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8235e4132b1445a8e574eb0f9101dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:06Z,use_quota=True,user_id='d6fb432ba61f409b86f69da8e2a543b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Creating volume 5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:06 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 2147483648 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:06 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 2147483648
Feb 27 01:26:06 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:06 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df421a1a-8062-4d4b-ac54-83f9ff3ed9db" returned: 0 in 0.883s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:06 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD" returned: 0 in 1.035s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Lock "cinder-quobyte-df421a1a-8062-4d4b-ac54-83f9ff3ed9db" released by "delete_volume" :: held 1.696s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Created reservations ['5e74ff46-3934-4992-933e-3b09a3662308', 'e6350cea-09bc-406c-8d66-ac229b3a7ffb', '8b545beb-8663-4648-b915-416937919d4d', '99cd176e-19dd-46cf-849d-9ec98636299e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:06 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:06 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:06 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 2147483648" returned: 0 in 0.822s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:07 devstack sudo[86870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235
Feb 27 01:26:07 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:07 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.098s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Deleted volume successfully.
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79f85035-918b-42a7-a7a0-3a30e0b0e562 tempest-VolumeQuotasAdminTestJSON-1755453268 None] Lock "cinder-df421a1a-8062-4d4b-ac54-83f9ff3ed9db-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Flow 'volume_create_manager' (a8f5f902-1e4a-4e8a-b82d-8571c37ada05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945264dc-9717-450c-964a-cbec86be22b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945264dc-9717-450c-964a-cbec86be22b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:08Z,deleted=False,deleted_at=None,display_description='',display_name='d4e05361-7a05-466f-92b5-8757c6dd9d6a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a0f06f-dba5-4fb9-ade5-e69cefddc96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b3a811eb144f50bd62ae833fcaf16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:08Z,use_quota=True,user_id='0a9ca83b606b47b0842e84babdf8a4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d59e73-1bf1-436c-8bf3-44a780c7859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d59e73-1bf1-436c-8bf3-44a780c7859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367230c2-e2dc-47cf-a679-6a8a9175c424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367230c2-e2dc-47cf-a679-6a8a9175c424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a0f06f-dba5-4fb9-ade5-e69cefddc96d', 'volume_name': 'volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e6e3a0-80d6-431c-8fe2-20b3eb478096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e6e3a0-80d6-431c-8fe2-20b3eb478096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be8ecec-1381-493f-b47e-a6098092f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Volume e2a0f06f-dba5-4fb9-ade5-e69cefddc96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d', 'volume_size': 1}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:08 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235" returned: 0 in 1.229s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2110876969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3329a027-f5b0-443e-a763-45eb2c4b054f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31c13c888444078cd41741da02c927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:04Z,use_quota=True,user_id='7e3754bff5f348bdba6756d6a8e7b1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Creating volume 3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:08 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:08 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f 1073741824
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e459cb2-65a3-4d04-affe-aa98964f8f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db07aca-b243-4ddf-8bda-d32fd00e7235', 'volume_size': 2}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:08 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f5b640-014b-4c23-ada7-538a13204c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Volume volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 (5db07aca-b243-4ddf-8bda-d32fd00e7235): created successfully
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f5b640-014b-4c23-ada7-538a13204c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Flow 'volume_create_manager' (dcd259b2-b65d-4221-95f7-6c7c2fc02a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b2e402bd-6059-48e2-851b-5b896294be52 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Created volume successfully.
Feb 27 01:26:08 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f 1073741824" returned: 0 in 0.657s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:08 devstack sudo[86882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:08 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:09 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:08Z,deleted=False,deleted_at=None,display_description='',display_name='d4e05361-7a05-466f-92b5-8757c6dd9d6a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a0f06f-dba5-4fb9-ade5-e69cefddc96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b3a811eb144f50bd62ae833fcaf16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:08Z,use_quota=True,user_id='0a9ca83b606b47b0842e84babdf8a4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Creating volume e2a0f06f-dba5-4fb9-ade5-e69cefddc96d {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:09 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:09 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d 1073741824
Feb 27 01:26:09 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Attempting download of 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 3329a027-f5b0-443e-a763-45eb2c4b054f. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1214e81-6183-44aa-8e98-0a2fad457b22]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:09 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe
Feb 27 01:26:09 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:10 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d 1073741824" returned: 0 in 0.711s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:10 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d
Feb 27 01:26:10 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:10 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe" returned: 0 in 0.892s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:10 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe
Feb 27 01:26:10 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:10 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" returned: 0 in 0.504s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.203s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be8ecec-1381-493f-b47e-a6098092f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d09bece-295c-40f4-8b41-13e401abe7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Creating offline snapshot fd6b5708-cad3-48f9-9d3c-824a6502bc80 of volume 5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:10 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Volume volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d (e2a0f06f-dba5-4fb9-ade5-e69cefddc96d): created successfully
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d09bece-295c-40f4-8b41-13e401abe7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Flow 'volume_create_manager' (a8f5f902-1e4a-4e8a-b82d-8571c37ada05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce4884d-a62c-4d47-8b15-c06ad3824454]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:10 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-997d4634-12a8-4219-baea-81b36b901e23 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Created volume successfully.
Feb 27 01:26:10 devstack sudo[86899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235
Feb 27 01:26:10 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:11 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe" returned: 1 in 0.835s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_9v2vjefe' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1b7bf5-0162-4ef4-9816-b007a1d137f7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:11 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD
Feb 27 01:26:11 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:11 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235" returned: 0 in 0.885s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 2G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:11 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 2G
Feb 27 01:26:11 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:12 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD" returned: 0 in 0.761s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:12 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 was qcow2, converting to raw {{(pid=83910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:26:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:12 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:12 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:12 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 2G" returned: 0 in 0.693s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:12 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80
Feb 27 01:26:12 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:13 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80" returned: 0 in 0.796s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:13 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 is being set with open permissions: ugo+rw
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:13 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80
Feb 27 01:26:13 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:13 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 0 in 1.266s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_nxhy_e_4devstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:26:13 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Converted 112.00 MB image at 88.26 MB/s
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:13 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f 1G
Feb 27 01:26:13 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Flow 'volume_create_manager' (f1deac1b-0dd7-4408-bb56-62830c40f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecc5930-005b-42f1-bf42-57eaaf8143e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecc5930-005b-42f1-bf42-57eaaf8143e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1904560171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef37fc0f-26ca-465e-b884-4090975c17bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2830f0ee83b44d20bab36de75bda476f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:14Z,use_quota=True,user_id='cf334419671543b49e5f89ce33a9f016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6729e793-e7ed-4b0a-9780-e9595035b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6729e793-e7ed-4b0a-9780-e9595035b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1c4831-0dc6-4553-8454-5a0f75cbf987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1c4831-0dc6-4553-8454-5a0f75cbf987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef37fc0f-26ca-465e-b884-4090975c17bb', 'volume_name': 'volume-ef37fc0f-26ca-465e-b884-4090975c17bb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff19d57-82f5-4092-9aaf-bf29838e33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff19d57-82f5-4092-9aaf-bf29838e33b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4346070c-ed5c-4a83-9f22-cafa6a61d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:13 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Volume ef37fc0f-26ca-465e-b884-4090975c17bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef37fc0f-26ca-465e-b884-4090975c17bb', 'volume_size': 1}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:13 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80" returned: 0 in 0.709s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:13 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info
Feb 27 01:26:13 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:13 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f 1G" returned: 0 in 0.590s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e98acc5-fd37-4d1f-af7a-94759becbe45]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:14 devstack sudo[86964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:14 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:14 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:14 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info is being set with open permissions: ugo+rw
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:14 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info
Feb 27 01:26:14 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:14 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 0 in 0.520s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:14 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:14 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:14 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.info" returned: 0 in 0.562s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.395s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100702e-1689-4991-a5f8-3054f20dfa8e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8fc2ebea-98b6-4eb3-847b-b7d5f1397425 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Create snapshot completed successfully
Feb 27 01:26:15 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d
Feb 27 01:26:15 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:15 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 1 in 0.591s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Downloaded image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 3329a027-f5b0-443e-a763-45eb2c4b054f successfully. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 for user 7e3754bff5f348bdba6756d6a8e7b1ab is deleted. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Marking volume 3329a027-f5b0-443e-a763-45eb2c4b054f as bootable. {{(pid=83910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Copying metadata from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 to 3329a027-f5b0-443e-a763-45eb2c4b054f. {{(pid=83910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Creating volume glance metadata for volume 3329a027-f5b0-443e-a763-45eb2c4b054f backed by image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18ef984-ae2c-4a04-a814-bf2d58fd77e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3329a027-f5b0-443e-a763-45eb2c4b054f', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ada504820>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba1c9fa-4c4b-4ab4-8451-1f4a4fbb7780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:15 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Volume volume-3329a027-f5b0-443e-a763-45eb2c4b054f (3329a027-f5b0-443e-a763-45eb2c4b054f): created successfully
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba1c9fa-4c4b-4ab4-8451-1f4a4fbb7780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Flow 'volume_create_manager' (64da7d4f-3e17-4851-bdd4-bf4517eaeed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e95c5c8f-7c13-463d-b252-f9a852eb51ee tempest-VolumesImageMetadata-2134386921 None] Created volume successfully.
Feb 27 01:26:15 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" returned: 0 in 0.570s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.586s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1904560171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef37fc0f-26ca-465e-b884-4090975c17bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2830f0ee83b44d20bab36de75bda476f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:14Z,use_quota=True,user_id='cf334419671543b49e5f89ce33a9f016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Creating volume ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:15 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:15 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb 1073741824
Feb 27 01:26:15 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9', 'name': 'volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01aa99b0-9874-4897-9977-a1a4dfb8f505', 'enforce_multipath': True} {{(pid=83910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 01:26:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-1cd2bf06-6c05-464e-a732-60b9e7ff0a90 req-f28fa462-b51b-4581-a127-1a40ba5d2f87 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] attachment_update completed successfully.
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "cinder-fd6b5708-cad3-48f9-9d3c-824a6502bc80-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-fd6b5708-cad3-48f9-9d3c-824a6502bc80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "cinder-quobyte-5db07aca-b243-4ddf-8bda-d32fd00e7235" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-quobyte-5db07aca-b243-4ddf-8bda-d32fd00e7235" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "cinder-quobyte-fd6b5708-cad3-48f9-9d3c-824a6502bc80" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-quobyte-fd6b5708-cad3-48f9-9d3c-824a6502bc80" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Deleting offline snapshot fd6b5708-cad3-48f9-9d3c-824a6502bc80 of volume 5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] snapshot_file for this snap is: volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a444b-f94e-49a4-b208-aea3a1d39dee]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb 1073741824" returned: 0 in 0.742s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb
Feb 27 01:26:16 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:16 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80
Feb 27 01:26:16 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Acquiring lock "cinder-3329a027-f5b0-443e-a763-45eb2c4b054f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Lock "cinder-3329a027-f5b0-443e-a763-45eb2c4b054f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Acquiring lock "cinder-quobyte-3329a027-f5b0-443e-a763-45eb2c4b054f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Lock "cinder-quobyte-3329a027-f5b0-443e-a763-45eb2c4b054f" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[681813cc-33ea-43a2-9532-f655ae1d3fc2]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[86991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:16 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:16 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80" returned: 0 in 0.637s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db07aca-b243-4ddf-8bda-d32fd00e7235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff68494-f3cb-4f3a-b63f-b44273563c9a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb" returned: 0 in 0.623s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4346070c-ed5c-4a83-9f22-cafa6a61d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef37fc0f-26ca-465e-b884-4090975c17bb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cea6ecb-1c16-4910-9cd3-485873591c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:16 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Volume volume-ef37fc0f-26ca-465e-b884-4090975c17bb (ef37fc0f-26ca-465e-b884-4090975c17bb): created successfully
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cea6ecb-1c16-4910-9cd3-485873591c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Flow 'volume_create_manager' (f1deac1b-0dd7-4408-bb56-62830c40f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:16 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235
Feb 27 01:26:16 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:16 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5aee6a03-7487-4bac-88bd-7fe898b0345c tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Created volume successfully.
Feb 27 01:26:17 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 0 in 0.658s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:17 devstack sudo[87001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:17 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:17 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235" returned: 0 in 0.533s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:17 devstack sudo[87006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80
Feb 27 01:26:17 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:17 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 1 in 0.695s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:26:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:17 devstack sudo[87077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f
Feb 27 01:26:17 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:18 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80" returned: 0 in 0.649s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:18 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80
Feb 27 01:26:18 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Creating offline snapshot 9bdad558-a0af-49ff-af75-c2ce0c8d11cb of volume ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdffdb57-89ed-4008-8eda-2ab1fdbe2b9e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:18 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb
Feb 27 01:26:18 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:18 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3329a027-f5b0-443e-a763-45eb2c4b054f" returned: 0 in 0.602s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Lock "cinder-quobyte-3329a027-f5b0-443e-a763-45eb2c4b054f" released by "delete_volume" :: held 2.002s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Created reservations ['21c7ac66-6574-457a-92f0-04f4ced0600d', 'c574342c-3d7c-4dae-8168-c70dab94cb0f', '324ae7bf-4e65-4712-9b8c-18543d25e444', '7a93100d-7203-48df-b7b5-a1a11434b1bf'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:18 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:18 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:18 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235.fd6b5708-cad3-48f9-9d3c-824a6502bc80" returned: 0 in 0.547s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-quobyte-fd6b5708-cad3-48f9-9d3c-824a6502bc80" released by "_delete_snapshot" :: held 2.459s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-quobyte-5db07aca-b243-4ddf-8bda-d32fd00e7235" released by "delete_snapshot" :: held 2.492s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Created reservations ['a6a7f6fe-4969-451a-9841-d65446f5cc2f', '5126bbf3-6c42-4a4d-8895-f302335ab794', '98dfa1bc-ecb5-4488-b393-46dae5e83a59', '9abf47cd-7ac4-4f14-92ac-2b93673110a2'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:18 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb" returned: 0 in 0.686s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:18 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Delete snapshot completed successfully.
Feb 27 01:26:18 devstack sudo[87095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb 1G
Feb 27 01:26:18 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a51c93df-cf38-4357-b141-7f96f5834fd7 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-fd6b5708-cad3-48f9-9d3c-824a6502bc80-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "cinder-5db07aca-b243-4ddf-8bda-d32fd00e7235-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-5db07aca-b243-4ddf-8bda-d32fd00e7235-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "cinder-quobyte-5db07aca-b243-4ddf-8bda-d32fd00e7235" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-quobyte-5db07aca-b243-4ddf-8bda-d32fd00e7235" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06dc6a7-2d8d-42d2-ab99-1ec1e936b8bb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:19 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.954s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Deleted volume successfully.
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-752916e4-4c1e-4ff6-ab7c-985a95fd6023 tempest-VolumesImageMetadata-2134386921 None] Lock "cinder-3329a027-f5b0-443e-a763-45eb2c4b054f-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:19 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb 1G" returned: 0 in 0.712s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef37fc0f-26ca-465e-b884-4090975c17bb -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:19 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235
Feb 27 01:26:19 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:19 devstack sudo[87105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef37fc0f-26ca-465e-b884-4090975c17bb -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb
Feb 27 01:26:19 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:20 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235" returned: 0 in 0.581s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:20 devstack sudo[87113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235
Feb 27 01:26:20 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:20 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef37fc0f-26ca-465e-b884-4090975c17bb -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb" returned: 0 in 0.665s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:20 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb is being set with open permissions: ugo+rw
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:20 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb
Feb 27 01:26:20 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:20 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5db07aca-b243-4ddf-8bda-d32fd00e7235" returned: 0 in 0.712s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-quobyte-5db07aca-b243-4ddf-8bda-d32fd00e7235" released by "delete_volume" :: held 1.346s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:20 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb" returned: 0 in 0.616s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Created reservations ['3f77a0e1-4ecd-456f-a450-1cfcf133e1aa', '2268d576-d180-4c0b-b525-019e8f9524b8', 'cde4a247-c73b-4e80-820c-e83aa9d8ddd5', 'ee597256-cd2b-4a25-adac-789d31ef73b4'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:20 devstack sudo[87452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info
Feb 27 01:26:20 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:21 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:21 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:22 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info" returned: 0 in 1.138s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:22 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info is being set with open permissions: ugo+rw
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:22 devstack sudo[87464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info
Feb 27 01:26:22 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:22 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 1.021s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Deleted volume successfully.
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f43c36ee-b1f9-46ae-b956-ba811c72d924 tempest-VolumesSnapshotNegativeTestJSON-1999358470 None] Lock "cinder-5db07aca-b243-4ddf-8bda-d32fd00e7235-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:22 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.info" returned: 0 in 0.660s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.555s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d26dfd83-12e8-4c39-ab33-37a6fa473454 tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Create snapshot completed successfully
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Flow 'volume_create_manager' (29d0909c-8181-44f4-bed2-ee2497d0a326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6e70c6-ef98-404e-a27a-bc5995a45321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6e70c6-ef98-404e-a27a-bc5995a45321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1458280310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4837d5a-be08-47e0-891b-e2f40c1de6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5c211613b048deb4dd8b05c971ef4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:23Z,use_quota=True,user_id='8a12b255f63948ed94a3cbeae5e9f472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4373028a-e10e-4ffa-954a-ed670312f45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4373028a-e10e-4ffa-954a-ed670312f45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa4609a-1360-4c70-a268-d6ebb7985960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa4609a-1360-4c70-a268-d6ebb7985960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4837d5a-be08-47e0-891b-e2f40c1de6c6', 'volume_name': 'volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6983432f-6482-4a61-bd86-4116c0589ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6983432f-6482-4a61-bd86-4116c0589ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea7a565-4176-4bf4-b74c-c55e9a3c1d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:23 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Volume c4837d5a-be08-47e0-891b-e2f40c1de6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6', 'volume_size': 1}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1458280310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4837d5a-be08-47e0-891b-e2f40c1de6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5c211613b048deb4dd8b05c971ef4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:23Z,use_quota=True,user_id='8a12b255f63948ed94a3cbeae5e9f472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Creating volume c4837d5a-be08-47e0-891b-e2f40c1de6c6 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:23 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:23 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 1073741824
Feb 27 01:26:23 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "cinder-9bdad558-a0af-49ff-af75-c2ce0c8d11cb-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-9bdad558-a0af-49ff-af75-c2ce0c8d11cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "cinder-quobyte-ef37fc0f-26ca-465e-b884-4090975c17bb" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-quobyte-ef37fc0f-26ca-465e-b884-4090975c17bb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "cinder-quobyte-9bdad558-a0af-49ff-af75-c2ce0c8d11cb" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-quobyte-9bdad558-a0af-49ff-af75-c2ce0c8d11cb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Deleting offline snapshot 9bdad558-a0af-49ff-af75-c2ce0c8d11cb of volume ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] snapshot_file for this snap is: volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e30d41-10d2-4cb2-a001-84f1d7c3e1d9]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:23 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb
Feb 27 01:26:23 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:23 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 1073741824" returned: 0 in 0.691s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:24 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6
Feb 27 01:26:24 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (8f7295a2-7ad6-4089-a90f-3133ce0333ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88905c7-5faa-45cd-8f84-3c0e141aefb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88905c7-5faa-45cd-8f84-3c0e141aefb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389338540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1051cd-9429-4ee1-a560-8a626779af04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:24Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653da4b7-fa22-4c4b-8037-9c642a3cdccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653da4b7-fa22-4c4b-8037-9c642a3cdccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadc455a-eb31-4030-bce9-a83fb027cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadc455a-eb31-4030-bce9-a83fb027cede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf1051cd-9429-4ee1-a560-8a626779af04', 'volume_name': 'volume-cf1051cd-9429-4ee1-a560-8a626779af04', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09462e4-5ac2-4b0d-9d6b-dbd8693cbd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09462e4-5ac2-4b0d-9d6b-dbd8693cbd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311e853d-6bcc-450d-877b-647ceb10335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume cf1051cd-9429-4ee1-a560-8a626779af04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf1051cd-9429-4ee1-a560-8a626779af04', 'volume_size': 1}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:24 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb" returned: 0 in 0.570s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef37fc0f-26ca-465e-b884-4090975c17bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee62db36-7d10-4085-b427-803dd4352516]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:24 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb
Feb 27 01:26:24 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:24 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6" returned: 0 in 0.539s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389338540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1051cd-9429-4ee1-a560-8a626779af04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:24Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating volume cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:24 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea7a565-4176-4bf4-b74c-c55e9a3c1d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 1073741824
Feb 27 01:26:24 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be85227-52c9-4548-8571-c03467d0caad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Volume volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 (c4837d5a-be08-47e0-891b-e2f40c1de6c6): created successfully
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be85227-52c9-4548-8571-c03467d0caad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Flow 'volume_create_manager' (29d0909c-8181-44f4-bed2-ee2497d0a326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b27b7462-46d8-4067-96e9-1c4cd0c6f09c tempest-VolumesTransfersV355Test-1585152247 None] Created volume successfully.
Feb 27 01:26:24 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb" returned: 0 in 0.567s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:24 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb
Feb 27 01:26:24 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 1073741824" returned: 0 in 0.620s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04
Feb 27 01:26:25 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb" returned: 0 in 0.640s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb
Feb 27 01:26:25 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311e853d-6bcc-450d-877b-647ceb10335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1051cd-9429-4ee1-a560-8a626779af04', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b199b32c-1f83-4c25-940e-6f0f5ce8f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:25 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume volume-cf1051cd-9429-4ee1-a560-8a626779af04 (cf1051cd-9429-4ee1-a560-8a626779af04): created successfully
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b199b32c-1f83-4c25-940e-6f0f5ce8f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (8f7295a2-7ad6-4089-a90f-3133ce0333ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:25 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b5eec754-6312-44de-b7cc-bbe9c549eafd tempest-CreateVolumesFromSnapshotTest-219236925 None] Created volume successfully.
Feb 27 01:26:25 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4ecf5e09-6523-44aa-a999-db1131dad99b tempest-VolumesTransfersV355Test-1380208340 None] Transfer volume completed successfully.
Feb 27 01:26:26 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb.9bdad558-a0af-49ff-af75-c2ce0c8d11cb" returned: 0 in 0.474s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-quobyte-9bdad558-a0af-49ff-af75-c2ce0c8d11cb" released by "_delete_snapshot" :: held 2.322s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-quobyte-ef37fc0f-26ca-465e-b884-4090975c17bb" released by "delete_snapshot" :: held 2.334s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Created reservations ['17fb637e-5cc0-4f01-8044-38c1f1323681', '60c20437-ebed-4f87-936a-2cfe2a7e1a40', 'bf1ee4ac-13b9-48c9-a731-38e5a5cc8c0d', 'f5c9142d-cde5-4f23-a692-bd3e20af75f8'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:26 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Delete snapshot completed successfully.
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1b97648c-603f-4eb4-a47e-c028fe923f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-9bdad558-a0af-49ff-af75-c2ce0c8d11cb-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating offline snapshot d855e65f-aaef-409b-90cf-c2124f33466b of volume cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2090201-cf2c-42ee-ab5f-8b9299e67c66]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:26 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04
Feb 27 01:26:26 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Acquiring lock "cinder-c4837d5a-be08-47e0-891b-e2f40c1de6c6-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-c4837d5a-be08-47e0-891b-e2f40c1de6c6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Acquiring lock "cinder-quobyte-c4837d5a-be08-47e0-891b-e2f40c1de6c6" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-quobyte-c4837d5a-be08-47e0-891b-e2f40c1de6c6" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762b794-01d0-459a-b68d-f657e237eb1b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "cinder-ef37fc0f-26ca-465e-b884-4090975c17bb-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-ef37fc0f-26ca-465e-b884-4090975c17bb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:26 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6
Feb 27 01:26:26 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "cinder-quobyte-ef37fc0f-26ca-465e-b884-4090975c17bb" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-quobyte-ef37fc0f-26ca-465e-b884-4090975c17bb" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:27 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04" returned: 0 in 0.694s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad0e711-6b8f-4d43-8410-5ab278d6233f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:27 devstack sudo[87509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b 1G
Feb 27 01:26:27 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:27 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb
Feb 27 01:26:27 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:27 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6" returned: 0 in 0.656s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:27 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6
Feb 27 01:26:27 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:27 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b 1G" returned: 0 in 0.611s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf1051cd-9429-4ee1-a560-8a626779af04 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:27 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb" returned: 0 in 0.614s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:27 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf1051cd-9429-4ee1-a560-8a626779af04 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b
Feb 27 01:26:27 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:27 devstack sudo[87526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb
Feb 27 01:26:27 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:27 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4837d5a-be08-47e0-891b-e2f40c1de6c6" returned: 0 in 0.505s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-quobyte-c4837d5a-be08-47e0-891b-e2f40c1de6c6" released by "delete_volume" :: held 1.197s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Created reservations ['63675254-850e-4029-b54e-d7fe4d59f1dd', '6cb4713f-517c-4fc2-bfcd-46108cc4fd3d', '7b168fe2-d328-4e48-9e65-fe57082d8307', '10af4ffe-35b6-44b4-a777-b9a8452655f0'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:28 devstack sudo[87534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:28 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:28 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf1051cd-9429-4ee1-a560-8a626779af04 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b" returned: 0 in 0.530s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b is being set with open permissions: ugo+rw
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:28 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b
Feb 27 01:26:28 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:28 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef37fc0f-26ca-465e-b884-4090975c17bb" returned: 0 in 0.570s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-quobyte-ef37fc0f-26ca-465e-b884-4090975c17bb" released by "delete_volume" :: held 1.245s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Created reservations ['cafa8f9e-1bb8-4b4c-a2d6-1ac13b8e2194', '0295419f-72b1-487d-9c21-4774285c34ab', '79ec6cd0-e156-4bd2-83fc-05a16342ffc2', 'e2567121-c952-474e-adf9-2d1abcd714c8'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:28 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:28 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:28 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.590s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Deleted volume successfully.
Feb 27 01:26:28 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-61ceab2f-77ab-4818-995e-129c46c83df8 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-c4837d5a-be08-47e0-891b-e2f40c1de6c6-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b" returned: 0 in 0.583s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:28 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info
Feb 27 01:26:28 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:29 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.628s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:29 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Deleted volume successfully.
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-83b42f84-c1dc-4f64-bcf5-8734b1266c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1637030178 None] Lock "cinder-ef37fc0f-26ca-465e-b884-4090975c17bb-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:29 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Flow 'volume_create_manager' (c0b9e892-da5a-4c03-a0cb-900bbaa637ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299a576c-a40c-4560-aa09-17de72a24132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info" returned: 0 in 0.675s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:29 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info is being set with open permissions: ugo+rw
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:29 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info
Feb 27 01:26:29 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299a576c-a40c-4560-aa09-17de72a24132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1117954854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7415d827-c7e5-4851-8d92-7c5b5daf0458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5c211613b048deb4dd8b05c971ef4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:29Z,use_quota=True,user_id='8a12b255f63948ed94a3cbeae5e9f472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f358c9d-2de1-4cc6-bb20-d46018f18e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f358c9d-2de1-4cc6-bb20-d46018f18e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403571fb-43b6-41d0-ad7d-59009441fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403571fb-43b6-41d0-ad7d-59009441fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7415d827-c7e5-4851-8d92-7c5b5daf0458', 'volume_name': 'volume-7415d827-c7e5-4851-8d92-7c5b5daf0458', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d5c4ef-dfc6-4536-b61f-56fb89879dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d5c4ef-dfc6-4536-b61f-56fb89879dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53571251-81db-4097-b57b-a5d3d66d004a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:29 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Volume 7415d827-c7e5-4851-8d92-7c5b5daf0458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7415d827-c7e5-4851-8d92-7c5b5daf0458', 'volume_size': 1}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:29 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.info" returned: 0 in 0.524s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.686s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1117954854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7415d827-c7e5-4851-8d92-7c5b5daf0458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5c211613b048deb4dd8b05c971ef4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:29Z,use_quota=True,user_id='8a12b255f63948ed94a3cbeae5e9f472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Creating volume 7415d827-c7e5-4851-8d92-7c5b5daf0458 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:30 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:30 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6ccb8daa-3232-4be9-a89a-f7d4cccf3205 tempest-CreateVolumesFromSnapshotTest-219236925 None] Create snapshot completed successfully
Feb 27 01:26:30 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 1073741824
Feb 27 01:26:30 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:30 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:30 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:30 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 1073741824" returned: 0 in 0.917s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:31 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458
Feb 27 01:26:31 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (4a79fae6-abfa-4322-887e-b70d8ef68a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe55681c-d73e-4377-837f-01e3db8f2f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe55681c-d73e-4377-837f-01e3db8f2f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734841591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e1cc9d-d805-45ab-b2da-8ff3625de646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:31Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f57f6a-eb4e-4534-ac57-3d7de14d6e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f57f6a-eb4e-4534-ac57-3d7de14d6e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ad2876-d235-41a3-a7af-abe3084f0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ad2876-d235-41a3-a7af-abe3084f0570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e1cc9d-d805-45ab-b2da-8ff3625de646', 'volume_name': 'volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6be5885-beea-465b-aba1-5fff88de8e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6be5885-beea-465b-aba1-5fff88de8e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff50b72-810b-4064-9f7d-60449ab79b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume b2e1cc9d-d805-45ab-b2da-8ff3625de646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646', 'volume_size': 1}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (f9f98600-ed7a-48c1-8dd0-0307b3a49c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527b1496-8732-4f19-990f-811ea974af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527b1496-8732-4f19-990f-811ea974af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-648890318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10445583-9ff0-4f30-bf90-6b21d7c4975e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae4a40e-e53c-4e8e-8856-63587c9b9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae4a40e-e53c-4e8e-8856-63587c9b9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33fae03-9b35-4bbd-888d-5a682e34c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33fae03-9b35-4bbd-888d-5a682e34c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10445583-9ff0-4f30-bf90-6b21d7c4975e', 'volume_name': 'volume-10445583-9ff0-4f30-bf90-6b21d7c4975e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654abc29-1d21-4837-8b4d-9d5f4e0b4a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654abc29-1d21-4837-8b4d-9d5f4e0b4a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77030ece-1921-4c8b-9aa5-d32d3e2d3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:31 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume 10445583-9ff0-4f30-bf90-6b21d7c4975e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10445583-9ff0-4f30-bf90-6b21d7c4975e', 'volume_size': 1}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.944s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=146,cinder:INSERT=51,cinder:UPDATE=199,cinder:DELETE=12 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=174,cinder:INSERT=60,cinder:UPDATE=159,cinder:DELETE=14 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (7b5887b4-3524-4656-8201-1ae735daf9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e998f15-97ea-4ea8-9412-c8ce1e506d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e998f15-97ea-4ea8-9412-c8ce1e506d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934942106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef25f829-32bd-4018-9db1-bb8bdba569c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e626cbf9-e5c9-459f-af29-6980f1cb463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e626cbf9-e5c9-459f-af29-6980f1cb463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14aa603-cad8-4b8c-aa63-9fbc18ece0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14aa603-cad8-4b8c-aa63-9fbc18ece0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef25f829-32bd-4018-9db1-bb8bdba569c4', 'volume_name': 'volume-ef25f829-32bd-4018-9db1-bb8bdba569c4', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e938616e-57f1-4cc3-a727-6836820a47d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e938616e-57f1-4cc3-a727-6836820a47d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8543357-b66f-4bc2-b1eb-9e908bccf71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume ef25f829-32bd-4018-9db1-bb8bdba569c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef25f829-32bd-4018-9db1-bb8bdba569c4', 'volume_size': 1}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:31 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458" returned: 0 in 0.913s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734841591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e1cc9d-d805-45ab-b2da-8ff3625de646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:31Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating volume b2e1cc9d-d805-45ab-b2da-8ff3625de646 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:31 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53571251-81db-4097-b57b-a5d3d66d004a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7415d827-c7e5-4851-8d92-7c5b5daf0458', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdc43c3-5756-4ab8-8f89-95b56de85a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Volume volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 (7415d827-c7e5-4851-8d92-7c5b5daf0458): created successfully
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdc43c3-5756-4ab8-8f89-95b56de85a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 1073741824
Feb 27 01:26:32 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Flow 'volume_create_manager' (c0b9e892-da5a-4c03-a0cb-900bbaa637ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:32 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ca2a548a-876c-4c43-ac25-a16edbb113f1 tempest-VolumesTransfersV355Test-1585152247 None] Created volume successfully.
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (a807699f-5500-44bb-b3fa-b3a97775264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f695e8-1f9e-45c4-ab1b-fd13b7f44367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f695e8-1f9e-45c4-ab1b-fd13b7f44367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745695780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f24eb1a-2310-4406-b15a-67a0cfa25ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c04d5c4-f6f1-4e5b-af06-47f839164fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c04d5c4-f6f1-4e5b-af06-47f839164fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7ae082-cf74-4366-903a-cc84538aa2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7ae082-cf74-4366-903a-cc84538aa2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f24eb1a-2310-4406-b15a-67a0cfa25ba2', 'volume_name': 'volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263e94bd-d250-44f0-855f-047df03f0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263e94bd-d250-44f0-855f-047df03f0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c50df0-d02e-4d61-ac93-d6bd78517881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume 8f24eb1a-2310-4406-b15a-67a0cfa25ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2', 'volume_size': 1}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (5367a4cb-e964-4b3f-914a-e541843651b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737f9357-f36a-4eb9-a3d6-0dc6b5981745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737f9357-f36a-4eb9-a3d6-0dc6b5981745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975437184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8aa1ff4-7308-4386-882d-ef7194715c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8285e8f5-2781-44de-a689-b2e65ecbb036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8285e8f5-2781-44de-a689-b2e65ecbb036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd6ff30-af0a-49cd-b629-a6b259649623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd6ff30-af0a-49cd-b629-a6b259649623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8aa1ff4-7308-4386-882d-ef7194715c51', 'volume_name': 'volume-a8aa1ff4-7308-4386-882d-ef7194715c51', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ccacdf-24f3-474d-adcb-15bbcf348936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ccacdf-24f3-474d-adcb-15bbcf348936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a6a165-6772-4adf-95b8-d376fdbd9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:32 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume a8aa1ff4-7308-4386-882d-ef7194715c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8aa1ff4-7308-4386-882d-ef7194715c51', 'volume_size': 1}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:32 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 1073741824" returned: 0 in 0.910s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:32 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646
Feb 27 01:26:32 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Acquiring lock "cinder-7415d827-c7e5-4851-8d92-7c5b5daf0458-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:32 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-7415d827-c7e5-4851-8d92-7c5b5daf0458-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Acquiring lock "cinder-quobyte-7415d827-c7e5-4851-8d92-7c5b5daf0458" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-quobyte-7415d827-c7e5-4851-8d92-7c5b5daf0458" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb98e77-6965-4db2-9cd1-9390313985f4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:33 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458
Feb 27 01:26:33 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:33 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646" returned: 0 in 0.534s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-648890318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10445583-9ff0-4f30-bf90-6b21d7c4975e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating volume 10445583-9ff0-4f30-bf90-6b21d7c4975e {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:33 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff50b72-810b-4064-9f7d-60449ab79b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d130911-9dec-4bbe-853f-124f08eaa91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:33 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e 1073741824
Feb 27 01:26:33 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:33 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 (b2e1cc9d-d805-45ab-b2da-8ff3625de646): created successfully
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d130911-9dec-4bbe-853f-124f08eaa91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (4a79fae6-abfa-4322-887e-b70d8ef68a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:33 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-eab834de-f47b-4b50-ad70-1f725938f052 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created volume successfully.
Feb 27 01:26:33 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458" returned: 0 in 0.672s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:33 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458
Feb 27 01:26:33 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Flow 'volume_create_manager' (c2a6873b-345b-4a21-bee2-9194472f4f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93eb481-0f36-43ef-aefc-171c8aab7dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93eb481-0f36-43ef-aefc-171c8aab7dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-892824919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f76655-c26b-4662-8736-3da3fb1683c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f5ba55e8c34bcea7e4bafbd664ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:34Z,use_quota=True,user_id='4d499e6722f3427687701a92193f0db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec08f4fc-e4d5-4472-b118-ffb5a0b492db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec08f4fc-e4d5-4472-b118-ffb5a0b492db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b8c545-1429-4182-babb-9c51fc49fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b8c545-1429-4182-babb-9c51fc49fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f76655-c26b-4662-8736-3da3fb1683c2', 'volume_name': 'volume-e0f76655-c26b-4662-8736-3da3fb1683c2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7322da52-bd31-4236-91d2-e87a7b1b6745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7322da52-bd31-4236-91d2-e87a7b1b6745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f9853a-b28a-4013-b639-1056d6a8036f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:34 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Volume e0f76655-c26b-4662-8736-3da3fb1683c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f76655-c26b-4662-8736-3da3fb1683c2', 'volume_size': 1}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:34 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e 1073741824" returned: 0 in 0.727s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:34 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e
Feb 27 01:26:34 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7415d827-c7e5-4851-8d92-7c5b5daf0458" returned: 0 in 0.598s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-quobyte-7415d827-c7e5-4851-8d92-7c5b5daf0458" released by "delete_volume" :: held 1.301s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Created reservations ['a69ac001-3f50-4091-a5ef-e072c3df045f', '0255b56e-3bb0-4c29-a524-f3bd2339bf2f', '8d9cc771-560d-4dd2-af1c-b854c13ae3b7', 'd17b4f59-787d-4dd3-a754-7c80fc99ebca'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:34 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:34 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e" returned: 0 in 0.441s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934942106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef25f829-32bd-4018-9db1-bb8bdba569c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating volume ef25f829-32bd-4018-9db1-bb8bdba569c4 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:34 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:34 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 1073741824
Feb 27 01:26:34 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77030ece-1921-4c8b-9aa5-d32d3e2d3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10445583-9ff0-4f30-bf90-6b21d7c4975e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c22706f-48de-4d98-9dd8-cbe1d4853c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:34 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume volume-10445583-9ff0-4f30-bf90-6b21d7c4975e (10445583-9ff0-4f30-bf90-6b21d7c4975e): created successfully
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c22706f-48de-4d98-9dd8-cbe1d4853c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (f9f98600-ed7a-48c1-8dd0-0307b3a49c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:34 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-563b2847-4f55-43fc-9d57-4f1fda816837 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created volume successfully.
Feb 27 01:26:34 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.460s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:34 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Deleted volume successfully.
Feb 27 01:26:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-740ecb8c-a241-4224-808d-a296d0e49858 tempest-VolumesTransfersV355Test-1235775506 None] Lock "cinder-7415d827-c7e5-4851-8d92-7c5b5daf0458-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:35 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 1073741824" returned: 0 in 0.582s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:35 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4
Feb 27 01:26:35 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:35 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4" returned: 0 in 0.667s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.839s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745695780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f24eb1a-2310-4406-b15a-67a0cfa25ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating volume 8f24eb1a-2310-4406-b15a-67a0cfa25ba2 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:35 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8543357-b66f-4bc2-b1eb-9e908bccf71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef25f829-32bd-4018-9db1-bb8bdba569c4', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:36 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 1073741824
Feb 27 01:26:36 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16223169-0c9a-4568-8c33-89a651ff0d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:36 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 (ef25f829-32bd-4018-9db1-bb8bdba569c4): created successfully
Feb 27 01:26:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16223169-0c9a-4568-8c33-89a651ff0d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (7b5887b4-3524-4656-8201-1ae735daf9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:36 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-def602c8-49c3-4e18-9898-44d50356bcbc tempest-CreateVolumesFromSnapshotTest-219236925 None] Created volume successfully.
Feb 27 01:26:36 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 1073741824" returned: 0 in 0.913s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:36 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2
Feb 27 01:26:36 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:37 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2" returned: 0 in 0.554s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.091s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975437184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8aa1ff4-7308-4386-882d-ef7194715c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a70473df6440b803a65be0151ec86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:32Z,use_quota=True,user_id='356bbf27d4a54f8c880bf507d957a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Creating volume a8aa1ff4-7308-4386-882d-ef7194715c51 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:37 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c50df0-d02e-4d61-ac93-d6bd78517881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcfdca0-2b38-466c-b6b8-e5b8ae04a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:37 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51 1073741824
Feb 27 01:26:37 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:37 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 (8f24eb1a-2310-4406-b15a-67a0cfa25ba2): created successfully
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcfdca0-2b38-466c-b6b8-e5b8ae04a472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (a807699f-5500-44bb-b3fa-b3a97775264d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:37 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d554bc48-414a-4fda-a415-ada2676b8deb tempest-CreateVolumesFromSnapshotTest-219236925 None] Created volume successfully.
Feb 27 01:26:38 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51 1073741824" returned: 0 in 0.832s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:38 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51
Feb 27 01:26:38 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:38 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51" returned: 0 in 0.515s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.776s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-892824919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f76655-c26b-4662-8736-3da3fb1683c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f5ba55e8c34bcea7e4bafbd664ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:34Z,use_quota=True,user_id='4d499e6722f3427687701a92193f0db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Creating volume e0f76655-c26b-4662-8736-3da3fb1683c2 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:38 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a6a165-6772-4adf-95b8-d376fdbd9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8aa1ff4-7308-4386-882d-ef7194715c51', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654c37c7-5f62-4b5d-8b5e-90a02f881d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Volume volume-a8aa1ff4-7308-4386-882d-ef7194715c51 (a8aa1ff4-7308-4386-882d-ef7194715c51): created successfully
Feb 27 01:26:38 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2 1073741824
Feb 27 01:26:38 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654c37c7-5f62-4b5d-8b5e-90a02f881d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Flow 'volume_create_manager' (5367a4cb-e964-4b3f-914a-e541843651b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:38 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6b71c12b-0909-499c-a217-bbf596e1323f tempest-CreateVolumesFromSnapshotTest-219236925 None] Created volume successfully.
Feb 27 01:26:39 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2 1073741824" returned: 0 in 0.707s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:39 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2
Feb 27 01:26:39 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-a8aa1ff4-7308-4386-882d-ef7194715c51-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-a8aa1ff4-7308-4386-882d-ef7194715c51-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-a8aa1ff4-7308-4386-882d-ef7194715c51" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-a8aa1ff4-7308-4386-882d-ef7194715c51" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e96668-ee71-4e0a-8294-6963400d3bd5]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:40 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2" returned: 0 in 0.574s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f9853a-b28a-4013-b639-1056d6a8036f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f76655-c26b-4662-8736-3da3fb1683c2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7fd1bb-fcc0-49a8-a43b-83bd7ff5552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Volume volume-e0f76655-c26b-4662-8736-3da3fb1683c2 (e0f76655-c26b-4662-8736-3da3fb1683c2): created successfully
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7fd1bb-fcc0-49a8-a43b-83bd7ff5552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Flow 'volume_create_manager' (c2a6873b-345b-4a21-bee2-9194472f4f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-48cc344e-eae1-44f1-a81d-dc8c70cb318f tempest-VolumesListAdminTestJSON-600787654 None] Created volume successfully.
Feb 27 01:26:40 devstack sudo[87714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51
Feb 27 01:26:40 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:40 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51" returned: 0 in 0.572s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:40 devstack sudo[87719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51
Feb 27 01:26:40 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:40 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Flow 'volume_create_manager' (6a7dd070-b9c5-4e32-839c-d4c4defc191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c635b7-21b8-4120-84cc-1e68f7b4f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c635b7-21b8-4120-84cc-1e68f7b4f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-468541976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f5ba55e8c34bcea7e4bafbd664ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:41Z,use_quota=True,user_id='4d499e6722f3427687701a92193f0db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744ec1e0-0901-4762-a8e6-2287b95ae756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744ec1e0-0901-4762-a8e6-2287b95ae756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03ca69-7496-4ae3-8bac-32d26e04f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03ca69-7496-4ae3-8bac-32d26e04f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53', 'volume_name': 'volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaf7cc8-e959-4315-bb49-e322719ab09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaf7cc8-e959-4315-bb49-e322719ab09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b9a176-c734-4fc0-855c-bfd5b1ae85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Volume a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53', 'volume_size': 1}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-468541976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f5ba55e8c34bcea7e4bafbd664ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:41Z,use_quota=True,user_id='4d499e6722f3427687701a92193f0db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Creating volume a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:41 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:41 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 1073741824
Feb 27 01:26:41 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Flow 'volume_create_manager' (e9d35da2-4d78-4f40-8201-3c71edb19da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf03463-86fe-49a3-bdb2-14d50e4e2cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf03463-86fe-49a3-bdb2-14d50e4e2cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-948932410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b66d5f698754adab5f11935dc4c7699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:41Z,use_quota=True,user_id='5c3a3b501a7f4aff94b8b4914dbf70d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e281c6a-6b9c-4dbf-a5a4-372a387a658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e281c6a-6b9c-4dbf-a5a4-372a387a658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19d409-a52e-4517-b240-4257975bf501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19d409-a52e-4517-b240-4257975bf501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f', 'volume_name': 'volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff87757a-54f6-4b91-ba14-ea9e6b7a0f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff87757a-54f6-4b91-ba14-ea9e6b7a0f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9b3b19-5acd-497e-b94d-c8426e99ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:41 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Volume d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f', 'volume_size': 1}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:41 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a8aa1ff4-7308-4386-882d-ef7194715c51" returned: 0 in 0.691s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-a8aa1ff4-7308-4386-882d-ef7194715c51" released by "delete_volume" :: held 1.316s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['5aad3e07-b2f4-4564-9a93-c7a27ef2a3ec', 'efc7fd5c-529a-4995-84e4-3bb9031048ae', 'c085b66d-4db9-4cc5-b45e-234beaa92743', 'cc21c15a-d3bc-4f9e-9be4-abd95093aba3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:41 devstack sudo[87756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:41 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:41 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 1073741824" returned: 0 in 0.759s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:42 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53
Feb 27 01:26:42 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:42 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.678s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleted volume successfully.
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f2662d5e-7b2c-44f3-9d90-413dbaa33574 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-a8aa1ff4-7308-4386-882d-ef7194715c51-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-8f24eb1a-2310-4406-b15a-67a0cfa25ba2-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-8f24eb1a-2310-4406-b15a-67a0cfa25ba2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-8f24eb1a-2310-4406-b15a-67a0cfa25ba2" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-8f24eb1a-2310-4406-b15a-67a0cfa25ba2" acquired by "delete_volume" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a305c28c-cf4e-45ec-8109-b658e0c52d53]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:42 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2
Feb 27 01:26:42 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:42 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53" returned: 0 in 0.632s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-948932410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b66d5f698754adab5f11935dc4c7699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:41Z,use_quota=True,user_id='5c3a3b501a7f4aff94b8b4914dbf70d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Creating volume d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:42 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b9a176-c734-4fc0-855c-bfd5b1ae85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b660df6-0d81-4114-929a-28e57eec8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:42 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f 1073741824
Feb 27 01:26:42 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Volume volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 (a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53): created successfully
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b660df6-0d81-4114-929a-28e57eec8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Flow 'volume_create_manager' (6a7dd070-b9c5-4e32-839c-d4c4defc191e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f18418ea-9581-4045-98ff-173d9b86505d tempest-VolumesListAdminTestJSON-600787654 None] Created volume successfully.
Feb 27 01:26:43 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2" returned: 0 in 0.558s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2
Feb 27 01:26:43 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:43 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f 1073741824" returned: 0 in 0.726s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f
Feb 27 01:26:43 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Flow 'volume_create_manager' (ba5c520c-1b69-42bf-a309-390b59d2144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26e1327-e6ba-44f4-9736-ae29c68a78b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26e1327-e6ba-44f4-9736-ae29c68a78b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1641086362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab25dbc-b275-494c-a5ed-12c7e9ab81b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f5ba55e8c34bcea7e4bafbd664ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:43Z,use_quota=True,user_id='4d499e6722f3427687701a92193f0db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89de5e0-b2d2-4432-a62c-ea84d9f4a6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89de5e0-b2d2-4432-a62c-ea84d9f4a6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dab601-7b56-438b-8986-ad4acaea369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dab601-7b56-438b-8986-ad4acaea369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab25dbc-b275-494c-a5ed-12c7e9ab81b7', 'volume_name': 'volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a52701-02d4-4052-8158-5a7dffea285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a52701-02d4-4052-8158-5a7dffea285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b879db0f-55f5-4bab-8521-75a8921db2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Volume 0ab25dbc-b275-494c-a5ed-12c7e9ab81b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7', 'volume_size': 1}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:43 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8f24eb1a-2310-4406-b15a-67a0cfa25ba2" returned: 0 in 0.590s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-8f24eb1a-2310-4406-b15a-67a0cfa25ba2" released by "delete_volume" :: held 1.170s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['67a7c736-e236-46cb-a5bc-d4c720a551b5', '12afeb8f-a68c-4b65-9ba8-4e9720b58bd4', 'e0430644-de03-487a-a9c0-48ecc0821940', 'f7801024-77ac-423e-a6cb-9cd8fdfdad76'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:43 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:43 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f" returned: 0 in 0.468s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.362s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1641086362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab25dbc-b275-494c-a5ed-12c7e9ab81b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f5ba55e8c34bcea7e4bafbd664ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:43Z,use_quota=True,user_id='4d499e6722f3427687701a92193f0db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Creating volume 0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:43 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9b3b19-5acd-497e-b94d-c8426e99ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 1073741824
Feb 27 01:26:43 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f90ca2-b333-4568-8df0-e68ae8ec20a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Volume volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f (d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f): created successfully
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f90ca2-b333-4568-8df0-e68ae8ec20a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Flow 'volume_create_manager' (e9d35da2-4d78-4f40-8201-3c71edb19da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9944dedd-91bc-4a2f-9c3a-7c75981ef86e tempest-VolumesTransfersV357Test-1490392833 None] Created volume successfully.
Feb 27 01:26:44 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.455s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:44 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleted volume successfully.
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5fd61fea-fde7-4df2-9b74-399c2a471189 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-8f24eb1a-2310-4406-b15a-67a0cfa25ba2-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:44 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 1073741824" returned: 0 in 0.625s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-ef25f829-32bd-4018-9db1-bb8bdba569c4-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:44 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7
Feb 27 01:26:44 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-ef25f829-32bd-4018-9db1-bb8bdba569c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-ef25f829-32bd-4018-9db1-bb8bdba569c4" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-ef25f829-32bd-4018-9db1-bb8bdba569c4" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea6522-877b-4d40-a1d9-95ab86800de1]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:44 devstack sudo[87847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4
Feb 27 01:26:44 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1ed08aea-a0d5-4e32-a789-585a74b07808 tempest-VolumesTransfersV357Test-1168301369 None] Transfer volume completed successfully.
Feb 27 01:26:45 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7" returned: 0 in 0.580s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b879db0f-55f5-4bab-8521-75a8921db2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510b96e8-0c88-4ede-bad5-d457e91594f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:45 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Volume volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 (0ab25dbc-b275-494c-a5ed-12c7e9ab81b7): created successfully
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510b96e8-0c88-4ede-bad5-d457e91594f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Flow 'volume_create_manager' (ba5c520c-1b69-42bf-a309-390b59d2144f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9569c3ee-0e7b-45ee-b44e-a0bd57b3504b tempest-VolumesListAdminTestJSON-600787654 None] Created volume successfully.
Feb 27 01:26:45 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4" returned: 0 in 0.553s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:45 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4
Feb 27 01:26:45 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:45 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ef25f829-32bd-4018-9db1-bb8bdba569c4" returned: 0 in 0.513s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-ef25f829-32bd-4018-9db1-bb8bdba569c4" released by "delete_volume" :: held 1.090s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['a2fd20d7-bfd6-45d3-a06b-6baa369121e5', 'ba1c00ce-9215-4ac8-8261-09253dada5cb', '842a0821-d40d-4ad9-ac59-258e4b37bb92', 'ba85a94d-25bd-4cf8-b644-493c2d49dde5'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:45 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:45 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Acquiring lock "cinder-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Acquiring lock "cinder-quobyte-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-quobyte-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db90fa-2537-427d-bc2c-46a203863ebe]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Flow 'volume_create_manager' (a4953f9f-c9de-4b85-be88-1793ebe355a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4617de-7345-4907-9fa2-0da5d4b16667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4617de-7345-4907-9fa2-0da5d4b16667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1571db43-9616-4623-9384-87907d1135d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6386cf451c024d4abd60606d8d174636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:46Z,use_quota=True,user_id='fb1b1b4f11a241a19238966a9dec446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634b7c1f-3c4e-420b-b042-9bdb6b43178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634b7c1f-3c4e-420b-b042-9bdb6b43178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6851354-d6d6-4349-bf03-33faa68a1444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:46 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f
Feb 27 01:26:46 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6851354-d6d6-4349-bf03-33faa68a1444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1571db43-9616-4623-9384-87907d1135d5', 'volume_name': 'volume-1571db43-9616-4623-9384-87907d1135d5', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5601fb7d-e7a1-4b95-a4c2-5e59c420eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5601fb7d-e7a1-4b95-a4c2-5e59c420eaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06167e04-4339-4bb6-9623-67395cb22b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:46 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Volume 1571db43-9616-4623-9384-87907d1135d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1571db43-9616-4623-9384-87907d1135d5', 'volume_size': 1}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1571db43-9616-4623-9384-87907d1135d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6386cf451c024d4abd60606d8d174636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:46Z,use_quota=True,user_id='fb1b1b4f11a241a19238966a9dec446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Creating volume 1571db43-9616-4623-9384-87907d1135d5 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:46 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:46 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5 1073741824
Feb 27 01:26:46 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:46 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.480s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleted volume successfully.
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-640dfc2a-6a4a-4d69-a7ac-1cfababc2092 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-ef25f829-32bd-4018-9db1-bb8bdba569c4-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:46 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f" returned: 0 in 0.490s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:46 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f
Feb 27 01:26:46 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:46 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5 1073741824" returned: 0 in 0.485s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:46 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5
Feb 27 01:26:46 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-10445583-9ff0-4f30-bf90-6b21d7c4975e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-10445583-9ff0-4f30-bf90-6b21d7c4975e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-10445583-9ff0-4f30-bf90-6b21d7c4975e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-10445583-9ff0-4f30-bf90-6b21d7c4975e" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d0fb9-7aa1-4c7d-ae9f-4cf6f70946f0]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:46 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e
Feb 27 01:26:46 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:47 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f" returned: 0 in 0.490s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-quobyte-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f" released by "delete_volume" :: held 1.007s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Created reservations ['cce8ef47-2a6c-4f6d-95e6-e447b2ef1581', 'd420b59b-df82-4d57-bbd7-dcaed541a29f', '387d40b0-a5f5-4d8f-b50f-61c0d272e663', 'eb9b1472-d98a-4cc8-a138-750a63154b07'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:47 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:47 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:47 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5" returned: 0 in 0.497s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06167e04-4339-4bb6-9623-67395cb22b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1571db43-9616-4623-9384-87907d1135d5', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70289b7-35bf-4ebf-85ff-9468d5d58ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:47 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Volume volume-1571db43-9616-4623-9384-87907d1135d5 (1571db43-9616-4623-9384-87907d1135d5): created successfully
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70289b7-35bf-4ebf-85ff-9468d5d58ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Flow 'volume_create_manager' (a4953f9f-c9de-4b85-be88-1793ebe355a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:47 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-70078d2e-d31b-4994-8636-e3897ba5df11 tempest-VolumesListAdminTestJSON-1898393897 None] Created volume successfully.
Feb 27 01:26:47 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e" returned: 0 in 0.522s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:47 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e
Feb 27 01:26:47 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:47 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.400s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:47 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Deleted volume successfully.
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-0f942ba6-13dc-41bf-a193-988f5875a2e5 tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-d9c9ad68-b2b4-4de5-ab13-ceb0fb0d628f-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:47 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-10445583-9ff0-4f30-bf90-6b21d7c4975e" returned: 0 in 0.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-10445583-9ff0-4f30-bf90-6b21d7c4975e" released by "delete_volume" :: held 0.993s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['a9a0ef57-b897-480a-bf27-64d4181629ca', '59417fdd-e3e9-41c2-8bb3-f5bc56ff8aaa', '881749b2-9d87-4c49-99ac-f6f6429e47c0', '47d124f7-c7ca-4e46-89f5-19fa709d333d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:47 devstack sudo[87894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:47 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Acquiring lock "cinder-1571db43-9616-4623-9384-87907d1135d5-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Lock "cinder-1571db43-9616-4623-9384-87907d1135d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Acquiring lock "cinder-quobyte-1571db43-9616-4623-9384-87907d1135d5" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Lock "cinder-quobyte-1571db43-9616-4623-9384-87907d1135d5" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f33254-3b57-4f0d-bcba-04fcaca58148]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:48 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "cinder-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Flow 'volume_create_manager' (c6c7b0a8-735c-4cf6-939c-b2305310b658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:48 devstack sudo[87897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5
Feb 27 01:26:48 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd20d9a0-08f5-4eb0-9dd8-9f2f810910aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.725s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleted volume successfully.
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd20d9a0-08f5-4eb0-9dd8-9f2f810910aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-921420776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ab9129-95b4-4ce8-be09-2d83ec92572c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b66d5f698754adab5f11935dc4c7699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:49Z,use_quota=True,user_id='5c3a3b501a7f4aff94b8b4914dbf70d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a880cc1e-b4ee-4d84-adef-9bc166e874f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a880cc1e-b4ee-4d84-adef-9bc166e874f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25780cf1-bcea-4529-a353-0475ea4dd919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25780cf1-bcea-4529-a353-0475ea4dd919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ab9129-95b4-4ce8-be09-2d83ec92572c', 'volume_name': 'volume-89ab9129-95b4-4ce8-be09-2d83ec92572c', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d2029d-8ddf-4a8c-bf4b-4bddbc4d9b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d2029d-8ddf-4a8c-bf4b-4bddbc4d9b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2b259-621e-49fa-9cb6-a2554f327d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:48 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Volume 89ab9129-95b4-4ce8-be09-2d83ec92572c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ab9129-95b4-4ce8-be09-2d83ec92572c', 'volume_size': 1}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-921420776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ab9129-95b4-4ce8-be09-2d83ec92572c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b66d5f698754adab5f11935dc4c7699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:49Z,use_quota=True,user_id='5c3a3b501a7f4aff94b8b4914dbf70d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Creating volume 89ab9129-95b4-4ce8-be09-2d83ec92572c {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:48 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:48 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c 1073741824
Feb 27 01:26:48 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9e58651d-7d73-472e-b79e-2b10fc7fc445 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-10445583-9ff0-4f30-bf90-6b21d7c4975e-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "cinder-quobyte-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-quobyte-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa42dfc-3261-4b00-98ef-227a0912e18b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:48 devstack sudo[87901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7
Feb 27 01:26:48 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-b2e1cc9d-d805-45ab-b2da-8ff3625de646-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-b2e1cc9d-d805-45ab-b2da-8ff3625de646-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-b2e1cc9d-d805-45ab-b2da-8ff3625de646" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-b2e1cc9d-d805-45ab-b2da-8ff3625de646" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f881c5ad-0a08-41d2-be6e-29abb8ee607a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646
Feb 27 01:26:49 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5" returned: 0 in 0.904s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5
Feb 27 01:26:49 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7" returned: 0 in 0.698s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[87916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7
Feb 27 01:26:49 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c 1073741824" returned: 0 in 0.944s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[87921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c
Feb 27 01:26:49 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646" returned: 0 in 0.704s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[87928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646
Feb 27 01:26:49 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:50 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1571db43-9616-4623-9384-87907d1135d5" returned: 0 in 0.642s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Lock "cinder-quobyte-1571db43-9616-4623-9384-87907d1135d5" released by "delete_volume" :: held 1.576s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Created reservations ['6709b831-2da3-4455-a239-90d146034abe', 'b6c03636-cda7-45fd-ae85-7e9f240ba3d4', '4b8fc9ba-eeef-45da-a90e-a2786b2a2c35', '02c45ee6-6e3e-4323-8d4b-74d444ce70cd'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:50 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7" returned: 0 in 0.665s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-quobyte-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7" released by "delete_volume" :: held 1.392s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:50 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:50 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Created reservations ['0c501fe8-2a5b-4254-93e9-59c2c546a2d5', 'b4ddb604-f7ad-4ba1-a5f0-5930b4796791', '305f623a-d143-477f-ab27-81618d52c137', '0a82ac4c-09e9-4f27-93d3-3e1d8bc3c80a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:50 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c" returned: 0 in 0.630s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2b259-621e-49fa-9cb6-a2554f327d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ab9129-95b4-4ce8-be09-2d83ec92572c', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836afdf1-0ca1-4e17-a1bd-12b4c29da6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:50 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Volume volume-89ab9129-95b4-4ce8-be09-2d83ec92572c (89ab9129-95b4-4ce8-be09-2d83ec92572c): created successfully
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836afdf1-0ca1-4e17-a1bd-12b4c29da6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Flow 'volume_create_manager' (c6c7b0a8-735c-4cf6-939c-b2305310b658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:50 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cef8c4ab-59c5-4135-ae40-c566f84d4ec8 tempest-VolumesTransfersV357Test-1490392833 None] Created volume successfully.
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:50 devstack sudo[87947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:50 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:50 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b2e1cc9d-d805-45ab-b2da-8ff3625de646" returned: 0 in 0.610s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-b2e1cc9d-d805-45ab-b2da-8ff3625de646" released by "delete_volume" :: held 1.337s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['524b2977-b170-4f27-9aaf-946468e767ea', '83ecefff-de10-4b80-bd89-0f9114c7a08b', 'b6f9a5c5-1e0f-4a84-8b63-932b4d1fee95', '82855fcb-907d-4fff-80df-c1782ec99d09'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:50 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:50 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:50 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.542s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:50 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Deleted volume successfully.
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fa8edd74-bd7d-44cb-9cb0-b1d4cd7b16fc tempest-VolumesListAdminTestJSON-1898393897 None] Lock "cinder-1571db43-9616-4623-9384-87907d1135d5-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "cinder-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:50 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.500s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:50 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Deleted volume successfully.
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ceac1f09-420b-428f-a0fa-abb3dd3e6dc3 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-0ab25dbc-b275-494c-a5ed-12c7e9ab81b7-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "cinder-quobyte-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-quobyte-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5c6406-9245-404c-b431-d3c0f3e033c5]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Acquiring lock "cinder-89ab9129-95b4-4ce8-be09-2d83ec92572c-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-89ab9129-95b4-4ce8-be09-2d83ec92572c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:51 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53
Feb 27 01:26:51 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Acquiring lock "cinder-quobyte-89ab9129-95b4-4ce8-be09-2d83ec92572c" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-quobyte-89ab9129-95b4-4ce8-be09-2d83ec92572c" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[094f320c-e361-4b9b-bd01-415ba6d62089]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.559s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:51 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleted volume successfully.
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd25f62e-b2ac-44d8-b7fa-1a751c36f745 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-b2e1cc9d-d805-45ab-b2da-8ff3625de646-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:51 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c
Feb 27 01:26:51 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-d855e65f-aaef-409b-90cf-c2124f33466b-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-d855e65f-aaef-409b-90cf-c2124f33466b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-cf1051cd-9429-4ee1-a560-8a626779af04" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-cf1051cd-9429-4ee1-a560-8a626779af04" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-d855e65f-aaef-409b-90cf-c2124f33466b" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-d855e65f-aaef-409b-90cf-c2124f33466b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleting offline snapshot d855e65f-aaef-409b-90cf-c2124f33466b of volume cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] snapshot_file for this snap is: volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d067598f-fa5c-4988-8186-3c52faffb773]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[87958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b
Feb 27 01:26:51 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53" returned: 0 in 0.585s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53
Feb 27 01:26:51 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c" returned: 0 in 0.577s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c
Feb 27 01:26:51 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b" returned: 0 in 0.541s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf1051cd-9429-4ee1-a560-8a626779af04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43e085-0cbf-497b-ae27-eaa67c34c28e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04
Feb 27 01:26:51 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53" returned: 0 in 0.435s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-quobyte-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53" released by "delete_volume" :: held 1.056s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Created reservations ['accaa39c-1af0-4fcc-ab10-f6c865b00e9c', 'febf3128-58d1-4241-b5b3-2a30a8173890', '663ec34c-1fa9-4997-b976-080a6ebaed94', 'fabb9780-596b-4e7a-8127-99fce8c773cc'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:52 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:52 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:52 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-89ab9129-95b4-4ce8-be09-2d83ec92572c" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-quobyte-89ab9129-95b4-4ce8-be09-2d83ec92572c" released by "delete_volume" :: held 1.061s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Created reservations ['e9f2cfca-cc6c-47c5-912d-df0b27d43e84', '05a80460-2cd3-4016-a2cd-45cefb9b9be7', '39edcfce-f0a8-4ec4-930e-b239b29861cc', '162c2950-cd6d-4728-a6b6-20bbdfc1ed88'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:52 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:52 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:52 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04" returned: 0 in 0.536s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:52 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b
Feb 27 01:26:52 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:52 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.421s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Deleted volume successfully.
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dc85c400-88b2-42c6-8b81-b59d1332b808 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-a6fb3a11-c4d7-4cf9-860e-cb0003a1ae53-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:52 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.452s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Deleted volume successfully.
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44977519-301e-496b-8a59-515b0785015d tempest-VolumesTransfersV357Test-493249058 None] Lock "cinder-89ab9129-95b4-4ce8-be09-2d83ec92572c-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:52 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:52 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b
Feb 27 01:26:52 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "cinder-e0f76655-c26b-4662-8736-3da3fb1683c2-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-e0f76655-c26b-4662-8736-3da3fb1683c2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "cinder-quobyte-e0f76655-c26b-4662-8736-3da3fb1683c2" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-quobyte-e0f76655-c26b-4662-8736-3da3fb1683c2" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df91bc4-b70b-4d8d-82f1-070d572a2dc1]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:53 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2
Feb 27 01:26:53 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:53 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04.d855e65f-aaef-409b-90cf-c2124f33466b" returned: 0 in 0.456s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-d855e65f-aaef-409b-90cf-c2124f33466b" released by "_delete_snapshot" :: held 2.114s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-cf1051cd-9429-4ee1-a560-8a626779af04" released by "delete_snapshot" :: held 2.129s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['d2488715-6a26-4a17-a1b8-c1452c52a194', '6a2e666f-6fd5-40f8-9268-65a9360f25d6', '0bf474f1-abe2-41f0-af22-45fb07aded4c', '3a318f0b-6710-4f15-9c8e-352cba2c5d72'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:53 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Delete snapshot completed successfully.
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f8c2969a-8702-4a89-8373-ae0400a5a0c1 tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-d855e65f-aaef-409b-90cf-c2124f33466b-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:53 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2" returned: 0 in 0.541s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:53 devstack sudo[88002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2
Feb 27 01:26:53 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:54 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e0f76655-c26b-4662-8736-3da3fb1683c2" returned: 0 in 0.636s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-quobyte-e0f76655-c26b-4662-8736-3da3fb1683c2" released by "delete_volume" :: held 1.210s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-cf1051cd-9429-4ee1-a560-8a626779af04-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-cf1051cd-9429-4ee1-a560-8a626779af04-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "cinder-quobyte-cf1051cd-9429-4ee1-a560-8a626779af04" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Created reservations ['2d0d7178-c490-47d5-a3df-8bdc47a0cb60', '8c4d7a34-62e4-41f1-998f-a4668785fbcb', '7a44bbba-0b46-4329-ace9-0621ca48691e', 'a7015525-a8c5-4b34-ac5c-42403dfc39d1'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-cf1051cd-9429-4ee1-a560-8a626779af04" acquired by "delete_volume" :: waited 0.068s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bb0ee3-738b-4f81-bf2b-03ceff767c77]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:54 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:54 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:54 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04
Feb 27 01:26:54 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:55 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.906s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:55 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Deleted volume successfully.
Feb 27 01:26:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b9ab1a50-e5b3-47c5-a08d-118abe6d78c9 tempest-VolumesListAdminTestJSON-600787654 None] Lock "cinder-e0f76655-c26b-4662-8736-3da3fb1683c2-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:55 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04" returned: 0 in 1.102s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:55 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04
Feb 27 01:26:55 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:56 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-cf1051cd-9429-4ee1-a560-8a626779af04" returned: 0 in 0.614s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-quobyte-cf1051cd-9429-4ee1-a560-8a626779af04" released by "delete_volume" :: held 1.793s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Created reservations ['8e54f808-64c0-4569-a02b-7d3b6ebb2124', 'd2611170-5a6c-41f1-a42e-1a5c784ed9a8', '0db319a6-b8b9-488b-926d-b235a68919f5', 'a53934a9-9089-4687-a1be-491c3ac421d2'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:56 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:26:56 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:57 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.639s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:57 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Deleted volume successfully.
Feb 27 01:26:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-26c613f5-5430-48af-bf3c-eb55bc41766d tempest-CreateVolumesFromSnapshotTest-219236925 None] Lock "cinder-cf1051cd-9429-4ee1-a560-8a626779af04-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Flow 'volume_create_manager' (e65da57e-51d3-48c4-a048-bc3052adb607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed97d1e-b799-4a37-86e7-cae7912ea450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed97d1e-b799-4a37-86e7-cae7912ea450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-915555799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f12594-f9ad-4313-bf3d-f959156572ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9da0afae634e42a1217c79b28e0edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:59Z,use_quota=True,user_id='ec996a279995420c86a756d08ec23aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a6aa4c-d2b7-445a-9160-2d749eb17c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a6aa4c-d2b7-445a-9160-2d749eb17c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b672890b-397f-4abb-9e6d-b71993e8affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b672890b-397f-4abb-9e6d-b71993e8affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f12594-f9ad-4313-bf3d-f959156572ec', 'volume_name': 'volume-a3f12594-f9ad-4313-bf3d-f959156572ec', 'volume_size': 2}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f32b52-f248-41cd-bbd7-8ee1f66c5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f32b52-f248-41cd-bbd7-8ee1f66c5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758ed708-a598-4e86-9c68-4fc9e5cd99bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:59 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Volume a3f12594-f9ad-4313-bf3d-f959156572ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f12594-f9ad-4313-bf3d-f959156572ec', 'volume_size': 2}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-915555799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f12594-f9ad-4313-bf3d-f959156572ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9da0afae634e42a1217c79b28e0edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:59Z,use_quota=True,user_id='ec996a279995420c86a756d08ec23aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Creating volume a3f12594-f9ad-4313-bf3d-f959156572ec {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:59 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec 2147483648 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:59 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec 2147483648
Feb 27 01:26:59 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:59 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (e56f96f4-e3e0-4be3-b22b-b94784c5c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ca22a1-8693-44e8-88f4-f5d8370b850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec 2147483648" returned: 0 in 0.757s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ca22a1-8693-44e8-88f4-f5d8370b850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44811605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:00Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae7c574-c846-49bc-9121-4bfe5ba3404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae7c574-c846-49bc-9121-4bfe5ba3404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c52203-c244-4d56-8349-fa0284e21945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c52203-c244-4d56-8349-fa0284e21945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1', 'volume_name': 'volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2f0b71-faff-484b-b706-8af8592bfaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2f0b71-faff-484b-b706-8af8592bfaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2fe5d-ec56-4848-9f0d-d155dd01d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:00 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1', 'volume_size': 1}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec
Feb 27 01:27:00 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec" returned: 0 in 0.521s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44811605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:00Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Creating volume b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:00 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758ed708-a598-4e86-9c68-4fc9e5cd99bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f12594-f9ad-4313-bf3d-f959156572ec', 'volume_size': 2}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cd6eb8-e728-4c6d-9bc7-6f1868386de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:00 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 1073741824
Feb 27 01:27:00 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Volume volume-a3f12594-f9ad-4313-bf3d-f959156572ec (a3f12594-f9ad-4313-bf3d-f959156572ec): created successfully
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cd6eb8-e728-4c6d-9bc7-6f1868386de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Flow 'volume_create_manager' (e65da57e-51d3-48c4-a048-bc3052adb607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:00 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e0919040-14d4-449d-b3a6-17112542f52e tempest-VolumesCloneNegativeTest-1937072807 None] Created volume successfully.
Feb 27 01:27:01 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 1073741824" returned: 0 in 0.795s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Acquiring lock "cinder-a3f12594-f9ad-4313-bf3d-f959156572ec-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:01 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1
Feb 27 01:27:01 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Lock "cinder-a3f12594-f9ad-4313-bf3d-f959156572ec-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Acquiring lock "cinder-quobyte-a3f12594-f9ad-4313-bf3d-f959156572ec" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Lock "cinder-quobyte-a3f12594-f9ad-4313-bf3d-f959156572ec" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f3537e-202d-45d9-8e9c-a9f07b35f0e1]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:01 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec
Feb 27 01:27:01 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:02 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1" returned: 0 in 0.680s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2fe5d-ec56-4848-9f0d-d155dd01d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59651d3f-c1e1-463f-880f-5c3b8e83f494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:02 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 (b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1): created successfully
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59651d3f-c1e1-463f-880f-5c3b8e83f494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (e56f96f4-e3e0-4be3-b22b-b94784c5c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:02 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9edb76eb-8bd3-4887-9329-831c8a92a30c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created volume successfully.
Feb 27 01:27:02 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec" returned: 0 in 0.667s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:02 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec
Feb 27 01:27:02 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:02 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a3f12594-f9ad-4313-bf3d-f959156572ec" returned: 0 in 0.567s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Lock "cinder-quobyte-a3f12594-f9ad-4313-bf3d-f959156572ec" released by "delete_volume" :: held 1.266s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Created reservations ['db3db401-af88-45e0-a6e1-77aa149482bd', '4cff676b-29f7-4113-8f2b-cdd26b85e004', 'a241c08a-a689-475c-a67e-b6b35810c671', 'd6f15949-7be3-43e3-a47e-b36de17a4829'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:02 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:02 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Flow 'volume_create_manager' (375e399b-b55a-4927-a390-ccd1b1f35686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7dd08f-58cb-4f6e-9e3d-499e9fab90e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7dd08f-58cb-4f6e-9e3d-499e9fab90e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-733790631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64d15c5-8649-47e7-9958-4928c6c7b893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda6c1dea0e047e2b5d0efbb6f965ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:03Z,use_quota=True,user_id='df5a24eccb3046a7b1b40ddb0d2ff795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4737e4-2edc-4baf-a459-0bf3aaa5d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4737e4-2edc-4baf-a459-0bf3aaa5d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed65075-fa80-4351-a96a-cf7ab0b481d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed65075-fa80-4351-a96a-cf7ab0b481d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64d15c5-8649-47e7-9958-4928c6c7b893', 'volume_name': 'volume-d64d15c5-8649-47e7-9958-4928c6c7b893', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c66fbc-ccc9-40d2-8d9b-4492d6123605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c66fbc-ccc9-40d2-8d9b-4492d6123605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8f899-176f-45ca-abeb-1c8925a5efa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Volume d64d15c5-8649-47e7-9958-4928c6c7b893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64d15c5-8649-47e7-9958-4928c6c7b893', 'volume_size': 1}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-733790631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64d15c5-8649-47e7-9958-4928c6c7b893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda6c1dea0e047e2b5d0efbb6f965ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:03Z,use_quota=True,user_id='df5a24eccb3046a7b1b40ddb0d2ff795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Creating volume d64d15c5-8649-47e7-9958-4928c6c7b893 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:03 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:03 devstack sudo[88099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893 1073741824
Feb 27 01:27:03 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (3c1c1fc6-e52d-47da-833c-5945e84d0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:03 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01635ec3-06bc-4141-baf2-60cfa86c9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.807s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01635ec3-06bc-4141-baf2-60cfa86c9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713220140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cae3e0-7e7f-40c3-bf56-c28948e22507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:04Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f22c960-b9dc-45dc-a3f0-b8c4604c1bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f22c960-b9dc-45dc-a3f0-b8c4604c1bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95edcad3-9a74-4ab8-b4b1-c76a18e765ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95edcad3-9a74-4ab8-b4b1-c76a18e765ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cae3e0-7e7f-40c3-bf56-c28948e22507', 'volume_name': 'volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7738e5-69df-4077-8395-97cdcd54fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7738e5-69df-4077-8395-97cdcd54fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e23505-4cc1-40b2-b139-ef5a3f0ca052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:03 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume f7cae3e0-7e7f-40c3-bf56-c28948e22507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507', 'volume_size': 1}
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:03 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Deleted volume successfully.
Feb 27 01:27:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a6904b7-f27b-43ae-91f7-2ad0752eb35b tempest-VolumesCloneNegativeTest-1937072807 None] Lock "cinder-a3f12594-f9ad-4313-bf3d-f959156572ec-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:04 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893 1073741824" returned: 0 in 0.901s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:04 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893
Feb 27 01:27:04 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (2b4f7078-ca0c-442b-9929-205e6dddf246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fa13b5-61c5-43d2-aab1-c17da32b6911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fa13b5-61c5-43d2-aab1-c17da32b6911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407991087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:04Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9acf60-a190-4769-8e8d-0531cd4a593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9acf60-a190-4769-8e8d-0531cd4a593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1f5e1-a8f6-4a6c-99a4-dc85627bcba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1f5e1-a8f6-4a6c-99a4-dc85627bcba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace', 'volume_name': 'volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d97b0e1-652e-4184-9ded-03f3230665ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d97b0e1-652e-4184-9ded-03f3230665ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd85601-195f-479f-83f5-747665e1aa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace', 'volume_size': 1}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (ef9a9bd9-7405-4908-9c60-0e36404765ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45f1992-36ea-40ce-80ae-0a6617f05490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45f1992-36ea-40ce-80ae-0a6617f05490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819092378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4816cff9-569a-43dd-ad0e-9baf21cf6934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:05Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2643763b-858a-4d7d-acdb-06500a8b4e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2643763b-858a-4d7d-acdb-06500a8b4e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0c69f9-4001-47c6-9d6a-e3c29570ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0c69f9-4001-47c6-9d6a-e3c29570ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4816cff9-569a-43dd-ad0e-9baf21cf6934', 'volume_name': 'volume-4816cff9-569a-43dd-ad0e-9baf21cf6934', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bc0175-3e3a-4af0-ac9b-07ada607e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bc0175-3e3a-4af0-ac9b-07ada607e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060a8329-8829-483d-8e6a-4d639876f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume 4816cff9-569a-43dd-ad0e-9baf21cf6934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4816cff9-569a-43dd-ad0e-9baf21cf6934', 'volume_size': 1}
Feb 27 01:27:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (8cc3a072-f2c4-4e84-b537-8b1b8917abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c8e637-6169-4fba-a31d-fd789b7216c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c8e637-6169-4fba-a31d-fd789b7216c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1730173143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a6b417-c7c6-4d41-92c1-013d4455e808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:05Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e2b304-b851-44d9-a0b1-27692080c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e2b304-b851-44d9-a0b1-27692080c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8eeb9-879b-48f6-810c-831ca9969dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8eeb9-879b-48f6-810c-831ca9969dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a6b417-c7c6-4d41-92c1-013d4455e808', 'volume_name': 'volume-44a6b417-c7c6-4d41-92c1-013d4455e808', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026736a2-fda8-4b02-bacd-22b1408d001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026736a2-fda8-4b02-bacd-22b1408d001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4be1489-0130-44eb-a76d-c303ae50696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume 44a6b417-c7c6-4d41-92c1-013d4455e808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a6b417-c7c6-4d41-92c1-013d4455e808', 'volume_size': 1}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893" returned: 0 in 1.313s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713220140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cae3e0-7e7f-40c3-bf56-c28948e22507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:04Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Creating volume f7cae3e0-7e7f-40c3-bf56-c28948e22507 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:05 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8f899-176f-45ca-abeb-1c8925a5efa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64d15c5-8649-47e7-9958-4928c6c7b893', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 1073741824
Feb 27 01:27:05 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd91cd6-776e-4701-95e4-40d0e6451108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (40ea1636-ea95-4572-aeba-e4769bd3b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07f9bd8-37f3-47a1-88fc-adc801502b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07f9bd8-37f3-47a1-88fc-adc801502b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935055513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c98cd4-ad52-4082-874e-51104aceda5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:05Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8e279c-ff0a-458d-85a3-2755d611694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8e279c-ff0a-458d-85a3-2755d611694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df92d79a-c38a-40a5-8fef-a61614f72f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df92d79a-c38a-40a5-8fef-a61614f72f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c98cd4-ad52-4082-874e-51104aceda5f', 'volume_name': 'volume-71c98cd4-ad52-4082-874e-51104aceda5f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a87d7e-3759-447a-a834-09e59c88cf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a87d7e-3759-447a-a834-09e59c88cf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c94f06a-6fdf-47af-9460-4a08aed7da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume 71c98cd4-ad52-4082-874e-51104aceda5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c98cd4-ad52-4082-874e-51104aceda5f', 'volume_size': 1}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Volume volume-d64d15c5-8649-47e7-9958-4928c6c7b893 (d64d15c5-8649-47e7-9958-4928c6c7b893): created successfully
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd91cd6-776e-4701-95e4-40d0e6451108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Flow 'volume_create_manager' (375e399b-b55a-4927-a390-ccd1b1f35686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:05 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-87db045f-2c57-4a3b-ab2c-c48715cbd165 tempest-AbsoluteLimitsTests-1717274809 None] Created volume successfully.
Feb 27 01:27:06 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 1073741824" returned: 0 in 0.870s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:06 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507
Feb 27 01:27:06 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Acquiring lock "cinder-d64d15c5-8649-47e7-9958-4928c6c7b893-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Lock "cinder-d64d15c5-8649-47e7-9958-4928c6c7b893-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Acquiring lock "cinder-quobyte-d64d15c5-8649-47e7-9958-4928c6c7b893" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Lock "cinder-quobyte-d64d15c5-8649-47e7-9958-4928c6c7b893" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d299b-7079-4c77-b0cb-96b83845c116]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:06 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893
Feb 27 01:27:06 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (4ceca6ad-21ee-4f6e-ae86-0ac84f657f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5725ee39-0c0e-4570-9350-2d23f4a7ce89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5725ee39-0c0e-4570-9350-2d23f4a7ce89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-563280721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419dcfe5-53c8-4145-9bcc-7fdccd78f09b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:07Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5ed44e-7970-4e9d-95c7-80bdd79d7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5ed44e-7970-4e9d-95c7-80bdd79d7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df71c5b-eee0-4f2f-8da8-814f7f5d4e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df71c5b-eee0-4f2f-8da8-814f7f5d4e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419dcfe5-53c8-4145-9bcc-7fdccd78f09b', 'volume_name': 'volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c080b9-3a30-47e8-a66d-cabc1055ac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c080b9-3a30-47e8-a66d-cabc1055ac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f86348-722c-4314-b76c-cf96ca39054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Volume 419dcfe5-53c8-4145-9bcc-7fdccd78f09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b', 'volume_size': 1}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:07 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507" returned: 0 in 0.907s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.981s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407991087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:04Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Creating volume e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:07 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e23505-4cc1-40b2-b139-ef5a3f0ca052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d29b2c4-9c2f-4063-9905-ae454be58d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 (f7cae3e0-7e7f-40c3-bf56-c28948e22507): created successfully
Feb 27 01:27:07 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace 1073741824
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d29b2c4-9c2f-4063-9905-ae454be58d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (3c1c1fc6-e52d-47da-833c-5945e84d0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-942d9b6f-4eb0-4dc2-ab2f-6e4ceb4db25c tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created volume successfully.
Feb 27 01:27:07 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893" returned: 0 in 0.743s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893
Feb 27 01:27:07 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:07 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d64d15c5-8649-47e7-9958-4928c6c7b893" returned: 0 in 0.450s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Lock "cinder-quobyte-d64d15c5-8649-47e7-9958-4928c6c7b893" released by "delete_volume" :: held 1.215s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Created reservations ['962875fc-2666-47e0-b3cd-cc76f97f4ce5', 'f3ce75f4-e187-4c89-b794-cd9783d1b05e', '3f580c7b-3d78-47e6-a0b6-2697ac549663', 'd2aa8e1a-9b94-4250-b389-b691cd40c43a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:07 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace 1073741824" returned: 0 in 0.643s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:08 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace
Feb 27 01:27:08 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:08 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:08 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.442s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Deleted volume successfully.
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-50ba63c2-0b97-4fb9-882e-5330162de993 tempest-AbsoluteLimitsTests-1717274809 None] Lock "cinder-d64d15c5-8649-47e7-9958-4928c6c7b893-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:08 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace" returned: 0 in 0.527s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.699s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819092378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4816cff9-569a-43dd-ad0e-9baf21cf6934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:05Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Creating volume 4816cff9-569a-43dd-ad0e-9baf21cf6934 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:08 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:08 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 1073741824
Feb 27 01:27:08 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd85601-195f-479f-83f5-747665e1aa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42e4263-d9b4-4ae5-9555-ecb0216cb235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace (e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace): created successfully
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42e4263-d9b4-4ae5-9555-ecb0216cb235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (2b4f7078-ca0c-442b-9929-205e6dddf246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bd5db192-0842-4c33-91e1-916a9e457d33 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created volume successfully.
Feb 27 01:27:09 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 1073741824" returned: 0 in 0.501s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:09 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934
Feb 27 01:27:09 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:09 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934" returned: 0 in 0.560s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.193s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1730173143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a6b417-c7c6-4d41-92c1-013d4455e808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:05Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Creating volume 44a6b417-c7c6-4d41-92c1-013d4455e808 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:09 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060a8329-8829-483d-8e6a-4d639876f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4816cff9-569a-43dd-ad0e-9baf21cf6934', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e030a-72c0-4429-b3ba-951d36fb32c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808 1073741824
Feb 27 01:27:09 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:09 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 (4816cff9-569a-43dd-ad0e-9baf21cf6934): created successfully
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e030a-72c0-4429-b3ba-951d36fb32c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (ef9a9bd9-7405-4908-9c60-0e36404765ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:09 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e2051165-8dd9-40a1-bd35-933a38d38d73 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created volume successfully.
Feb 27 01:27:10 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808 1073741824" returned: 0 in 0.796s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:10 devstack sudo[88152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808
Feb 27 01:27:10 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:10 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808" returned: 0 in 0.536s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935055513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c98cd4-ad52-4082-874e-51104aceda5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc90e96ef0a4b14a58f7313d4335215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:05Z,use_quota=True,user_id='0595143a9dbf4705adc492152c056550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Creating volume 71c98cd4-ad52-4082-874e-51104aceda5f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:11 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4be1489-0130-44eb-a76d-c303ae50696c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a6b417-c7c6-4d41-92c1-013d4455e808', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03c0ee4-bd4c-4c9c-85da-ce2a90e20ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:11 devstack sudo[88155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f 1073741824
Feb 27 01:27:11 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:11 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume volume-44a6b417-c7c6-4d41-92c1-013d4455e808 (44a6b417-c7c6-4d41-92c1-013d4455e808): created successfully
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03c0ee4-bd4c-4c9c-85da-ce2a90e20ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (8cc3a072-f2c4-4e84-b537-8b1b8917abcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f0531382-05c2-486f-a5f1-c9797db67230 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created volume successfully.
Feb 27 01:27:11 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f 1073741824" returned: 0 in 0.656s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:11 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f
Feb 27 01:27:11 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Flow 'volume_create_manager' (911f50b0-602c-4446-841e-095c7b4c01c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0136a21-efca-434d-b189-42b6956e180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0136a21-efca-434d-b189-42b6956e180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132946693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbc7963-b0eb-4699-984d-e97da3e96688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456f744baf6845ed9e0749d27dbdc291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:12Z,use_quota=True,user_id='5817b867c36f42cd96927c5a1b56c398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77682e1-3e71-4bcb-9374-266724111cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77682e1-3e71-4bcb-9374-266724111cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f51816-d323-4470-8703-1040cd13aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f51816-d323-4470-8703-1040cd13aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bbc7963-b0eb-4699-984d-e97da3e96688', 'volume_name': 'volume-1bbc7963-b0eb-4699-984d-e97da3e96688', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e582410-0ca1-4b0f-b90e-5be1421929b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e582410-0ca1-4b0f-b90e-5be1421929b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ebb2ac-bcfe-4700-bedc-2cc217661ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:12 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Volume 1bbc7963-b0eb-4699-984d-e97da3e96688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bbc7963-b0eb-4699-984d-e97da3e96688', 'volume_size': 1}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:12 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f" returned: 0 in 0.499s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.946s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-563280721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419dcfe5-53c8-4145-9bcc-7fdccd78f09b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:07Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Creating volume 419dcfe5-53c8-4145-9bcc-7fdccd78f09b {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:12 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c94f06a-6fdf-47af-9460-4a08aed7da51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c98cd4-ad52-4082-874e-51104aceda5f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:12 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b 1073741824
Feb 27 01:27:12 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec233cf-4084-4a70-84b8-8f9f793cf59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:12 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Volume volume-71c98cd4-ad52-4082-874e-51104aceda5f (71c98cd4-ad52-4082-874e-51104aceda5f): created successfully
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec233cf-4084-4a70-84b8-8f9f793cf59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Flow 'volume_create_manager' (40ea1636-ea95-4572-aeba-e4769bd3b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:12 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ce9638d5-9b45-4c62-ab1a-435367753a16 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created volume successfully.
Feb 27 01:27:12 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b 1073741824" returned: 0 in 0.585s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:12 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b
Feb 27 01:27:12 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-71c98cd4-ad52-4082-874e-51104aceda5f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-71c98cd4-ad52-4082-874e-51104aceda5f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-quobyte-71c98cd4-ad52-4082-874e-51104aceda5f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-71c98cd4-ad52-4082-874e-51104aceda5f" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a33739-213e-41c2-a10f-7f9025f89f0c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:13 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f
Feb 27 01:27:13 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b" returned: 0 in 0.729s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132946693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbc7963-b0eb-4699-984d-e97da3e96688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456f744baf6845ed9e0749d27dbdc291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:12Z,use_quota=True,user_id='5817b867c36f42cd96927c5a1b56c398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Creating volume 1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:13 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f86348-722c-4314-b76c-cf96ca39054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4902b759-2653-4c3d-a14d-911bca798227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:13 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 1073741824
Feb 27 01:27:13 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Volume volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b (419dcfe5-53c8-4145-9bcc-7fdccd78f09b): created successfully
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4902b759-2653-4c3d-a14d-911bca798227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (4ceca6ad-21ee-4f6e-ae86-0ac84f657f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bf9b1123-50de-4b51-9192-6e2b6f1a8960 tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:27:14 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f" returned: 0 in 0.772s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:14 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f
Feb 27 01:27:14 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:14 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 1073741824" returned: 0 in 0.897s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:14 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:14 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Flow 'volume_create_manager' (d1cf633c-0c20-41e2-b17d-02e208d74e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c69da6-574f-478d-943d-2eb98b29a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c69da6-574f-478d-943d-2eb98b29a784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff640b2-7c53-4d99-8278-5624ed11c70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b3a811eb144f50bd62ae833fcaf16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='0a9ca83b606b47b0842e84babdf8a4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ba0f5b-8b48-4bd1-82d8-dcfe59780493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ba0f5b-8b48-4bd1-82d8-dcfe59780493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae0a0ec-c474-4f00-b42a-a5f26d090009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.image.glance [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Creating Keystone auth plugin from conf {{(pid=83910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:27:14 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-71c98cd4-ad52-4082-874e-51104aceda5f" returned: 0 in 0.803s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-71c98cd4-ad52-4082-874e-51104aceda5f" released by "delete_volume" :: held 1.606s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae0a0ec-c474-4f00-b42a-a5f26d090009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ff640b2-7c53-4d99-8278-5624ed11c70e', 'volume_name': 'volume-9ff640b2-7c53-4d99-8278-5624ed11c70e', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ada419b70>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3862e8f7-7a94-4fdb-9a60-11b3d5d302a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3862e8f7-7a94-4fdb-9a60-11b3d5d302a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceda74f8-fe34-4898-b7ab-a5e7e4495eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Volume 9ff640b2-7c53-4d99-8278-5624ed11c70e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ff640b2-7c53-4d99-8278-5624ed11c70e', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ada419b70>}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Trying to clone 9ff640b2-7c53-4d99-8278-5624ed11c70e from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]). {{(pid=83910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created reservations ['dcb593e5-70f2-470b-a8c5-f00a87f72a24', 'adcdc107-494d-4b3a-9389-114010933552', '865bdf00-e313-415d-a800-41c52f006e88', '07aa5d8b-699a-499b-8cd7-1aaf122d65f8'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:15 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.721s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:15 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:15 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ebb2ac-bcfe-4700-bedc-2cc217661ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbc7963-b0eb-4699-984d-e97da3e96688', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352f9852-ed5c-4768-82fe-3b43f78b40c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Volume volume-1bbc7963-b0eb-4699-984d-e97da3e96688 (1bbc7963-b0eb-4699-984d-e97da3e96688): created successfully
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352f9852-ed5c-4768-82fe-3b43f78b40c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Flow 'volume_create_manager' (911f50b0-602c-4446-841e-095c7b4c01c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e0068794-c68a-4bae-93f7-588866ff73fb tempest-VolumesDeleteCascade-305291070 None] Created volume successfully.
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-44a6b417-c7c6-4d41-92c1-013d4455e808-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (a7c19355-2b51-4eda-a79e-225afbdb1a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5859a6ff-b963-4963-9310-d8b323ced087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5859a6ff-b963-4963-9310-d8b323ced087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1674916757',display_name='tempest-VolumesGetTest-Volume-363407211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8a05dd-5b1f-4f09-b76e-84006bfe86a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1855669-51cc-4782-abe1-a59a09f3f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1855669-51cc-4782-abe1-a59a09f3f331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829d4232-58ec-48b9-9be7-c788e641227f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829d4232-58ec-48b9-9be7-c788e641227f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8a05dd-5b1f-4f09-b76e-84006bfe86a0', 'volume_name': 'volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25dc434-3ce3-4f6b-a381-6227df1e8715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25dc434-3ce3-4f6b-a381-6227df1e8715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65048af5-c454-48cd-90fa-043a045c2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Volume ff8a05dd-5b1f-4f09-b76e-84006bfe86a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0', 'volume_size': 1}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1674916757',display_name='tempest-VolumesGetTest-Volume-363407211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8a05dd-5b1f-4f09-b76e-84006bfe86a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Creating volume ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-44a6b417-c7c6-4d41-92c1-013d4455e808-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:15 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 1073741824
Feb 27 01:27:15 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6504e8-a91a-4b0e-8e01-d91822bd7999]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-quobyte-44a6b417-c7c6-4d41-92c1-013d4455e808" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-44a6b417-c7c6-4d41-92c1-013d4455e808" acquired by "delete_volume" :: waited 0.023s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a9821a-35fa-4e6d-8e1d-20e06a64a9fb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:15 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808
Feb 27 01:27:15 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:15 devstack sudo[88194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD
Feb 27 01:27:15 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:15 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.755s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:15 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Deleted volume successfully.
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c47315fd-67ae-441f-9aa1-01652e96e267 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-71c98cd4-ad52-4082-874e-51104aceda5f-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:16 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 1073741824" returned: 0 in 0.531s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:16 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0
Feb 27 01:27:16 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:16 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 is fetched for user 0a9ca83b606b47b0842e84babdf8a4fd. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:27:16 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808" returned: 0 in 0.642s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:16 devstack sudo[88211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808
Feb 27 01:27:16 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa65c2c-98d2-423a-8758-308051f4d17a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:16 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD
Feb 27 01:27:16 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:16 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0" returned: 0 in 0.752s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.211s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Creating offline snapshot c362dcce-6aa7-4529-8a10-a54617d74744 of volume 1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65048af5-c454-48cd-90fa-043a045c2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb1cf0-2f9d-4b46-9267-673ec9d97696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[548f0642-45a6-457f-9970-3871d57dbdd2]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:17 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Volume volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 (ff8a05dd-5b1f-4f09-b76e-84006bfe86a0): created successfully
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb1cf0-2f9d-4b46-9267-673ec9d97696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (a7c19355-2b51-4eda-a79e-225afbdb1a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d1758f63-c4ce-47d3-9d45-a21b82636feb tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:27:17 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:17 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:17 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-44a6b417-c7c6-4d41-92c1-013d4455e808" returned: 0 in 0.852s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-44a6b417-c7c6-4d41-92c1-013d4455e808" released by "delete_volume" :: held 1.525s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created reservations ['4e28977a-fbed-46f3-8c4b-ce0a90bedfbc', 'a11b8158-6c74-4148-b3c8-5b68377a87ea', 'ea4862df-2a7d-470d-bacc-3e1047d686e1', 'c16bcb37-5b39-48e8-9c18-114d52b0c83e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:17 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:17 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:17 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:17 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.528s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:17 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 1G
Feb 27 01:27:17 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf716ae-0a4f-413c-b139-71aec6a188f4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-4816cff9-569a-43dd-ad0e-9baf21cf6934-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-4816cff9-569a-43dd-ad0e-9baf21cf6934-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-quobyte-4816cff9-569a-43dd-ad0e-9baf21cf6934" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-4816cff9-569a-43dd-ad0e-9baf21cf6934" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c9b506-2e5d-409a-b504-f8e9b408c1ea]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.655s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:18 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Deleted volume successfully.
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce3249f5-6f1d-406a-838b-beab228458de tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-44a6b417-c7c6-4d41-92c1-013d4455e808-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:18 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0
Feb 27 01:27:18 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934
Feb 27 01:27:18 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 1G" returned: 0 in 0.838s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:18 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0" returned: 0 in 0.682s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0
Feb 27 01:27:18 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934" returned: 0 in 0.667s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934
Feb 27 01:27:18 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.627s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 is being set with open permissions: ugo+rw
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:19 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:19 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0" returned: 0 in 0.589s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0" released by "delete_volume" :: held 1.306s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Created reservations ['2ece4089-0cce-4b2c-b163-cc4b6ad9de41', 'c5bd3064-5886-480d-a29c-cb88420cd2d5', 'c58ff7bf-4577-418c-888c-551a9b776fcc', '46d04c68-1cc9-40e7-93c7-cc163d94cb9d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:19 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:19 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:19 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4816cff9-569a-43dd-ad0e-9baf21cf6934" returned: 0 in 0.593s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-4816cff9-569a-43dd-ad0e-9baf21cf6934" released by "delete_volume" :: held 1.306s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created reservations ['03128611-103f-40de-8e8c-945d0acda7e7', 'f8a3ac3f-8cb5-482e-8c47-073c5e97fa92', 'fadac16d-1b4e-4f4e-bf3d-3c9119994fba', '1df360c2-4f5b-4098-a2c3-b9af033c2b91'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:19 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.530s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:19 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:19 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info
Feb 27 01:27:19 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:27:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3672c259-69ef-4170-b9ea-92c8e77d54a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-ff8a05dd-5b1f-4f09-b76e-84006bfe86a0-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:20 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.469s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Deleted volume successfully.
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53cb28be-49dc-46a6-acea-51aa12702bc0 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-4816cff9-569a-43dd-ad0e-9baf21cf6934-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:20 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info" returned: 0 in 0.473s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:20 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info is being set with open permissions: ugo+rw
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:20 devstack sudo[88287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info
Feb 27 01:27:20 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-419dcfe5-53c8-4145-9bcc-7fdccd78f09b-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-419dcfe5-53c8-4145-9bcc-7fdccd78f09b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-quobyte-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-419dcfe5-53c8-4145-9bcc-7fdccd78f09b" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace" acquired by "delete_volume" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-419dcfe5-53c8-4145-9bcc-7fdccd78f09b" acquired by "delete_volume" :: waited 0.034s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff1658-2490-472f-ba16-a4829c3cc109]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[030089ba-a00a-4b21-a230-fb8f9760ce64]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:20 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace
Feb 27 01:27:20 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:20 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b
Feb 27 01:27:20 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:20 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.info" returned: 0 in 0.548s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.672s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.245s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff640b2-7c53-4d99-8278-5624ed11c70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b3a811eb144f50bd62ae833fcaf16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='0a9ca83b606b47b0842e84babdf8a4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Creating volume 9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:20 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:20 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e 1073741824
Feb 27 01:27:20 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-89bfcc84-339b-43e3-9d82-b8cc782118e6 tempest-VolumesDeleteCascade-305291070 None] Create snapshot completed successfully
Feb 27 01:27:21 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace" returned: 0 in 0.710s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace
Feb 27 01:27:21 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:21 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b" returned: 0 in 0.757s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack sudo[88304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b
Feb 27 01:27:21 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:21 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e 1073741824" returned: 0 in 0.747s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack sudo[88310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:27:21 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:21 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace" returned: 0 in 0.530s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace" released by "delete_volume" :: held 1.286s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created reservations ['0d70865d-a0dc-49f3-a37a-60b3781a1b13', 'f9a8d797-ac59-4c01-901f-a79500ffcfae', '6d86443d-babd-4266-9c54-2482b49f28bb', 'c6ab65a6-0c2e-47cd-9af2-ddd549d10a69'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:21 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:21 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-419dcfe5-53c8-4145-9bcc-7fdccd78f09b" returned: 0 in 0.617s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-419dcfe5-53c8-4145-9bcc-7fdccd78f09b" released by "delete_volume" :: held 1.414s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Created reservations ['0f7b6826-d848-4e3a-b50a-4512b59be565', 'c2975900-3760-4b6c-8974-73c008060578', '51e7b1f3-e38a-4f36-b401-ceda91235a4b', '3ef1d13f-5de2-418a-aaed-1e010ff75a00'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:21 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:21 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 0 in 0.463s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.747s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Creating offline snapshot cf2d4581-5a17-4137-9d63-fcf034f4064d of volume 1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Attempting download of 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 9ff640b2-7c53-4d99-8278-5624ed11c70e. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf6f3bd-6544-410d-a223-98ede052ac09]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[574e2a9c-e9ff-4908-b4e4-bb734eee8081]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:22 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:22 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:22 devstack sudo[88319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5
Feb 27 01:27:22 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:22 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.667s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Deleted volume successfully.
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6b3e6606-0e25-4e89-8620-b9fae33c7ae5 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-e3ca3a2f-b6e2-47f0-be5b-d846cd5d2ace-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-f7cae3e0-7e7f-40c3-bf56-c28948e22507-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-f7cae3e0-7e7f-40c3-bf56-c28948e22507-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-quobyte-f7cae3e0-7e7f-40c3-bf56-c28948e22507" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-f7cae3e0-7e7f-40c3-bf56-c28948e22507" acquired by "delete_volume" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b14374-6b25-433b-b2eb-c086850e5ddb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:22 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.783s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e5466797-40c1-49d8-92c8-3afd95d4a1a4 tempest-VolumesGetTest-1221146508 None] Lock "cinder-419dcfe5-53c8-4145-9bcc-7fdccd78f09b-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:22 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507
Feb 27 01:27:22 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:22 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (da8a94c1-08d8-4bb9-84e7-84916d8523de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c086a7-f905-4d94-ba0c-3921ca07d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c086a7-f905-4d94-ba0c-3921ca07d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254012146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453c351e-d6e7-49df-b167-17acbece769e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:23Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37efa2f3-ced4-4648-97eb-391cf8e85025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37efa2f3-ced4-4648-97eb-391cf8e85025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae5f84d-4e39-44fe-ab96-6150f1c5a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae5f84d-4e39-44fe-ab96-6150f1c5a367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453c351e-d6e7-49df-b167-17acbece769e', 'volume_name': 'volume-453c351e-d6e7-49df-b167-17acbece769e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cf34f1-c845-4c69-9862-7b19339fadd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cf34f1-c845-4c69-9862-7b19339fadd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88903bc7-5ff7-4eb5-8d55-f5d7e51315d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:22 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Volume 453c351e-d6e7-49df-b167-17acbece769e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453c351e-d6e7-49df-b167-17acbece769e', 'volume_size': 1}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.897s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbc7963-b0eb-4699-984d-e97da3e96688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:22 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d 1G
Feb 27 01:27:22 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:22 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5" returned: 0 in 0.932s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5
Feb 27 01:27:23 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507" returned: 0 in 0.758s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507
Feb 27 01:27:23 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d 1G" returned: 0 in 0.592s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d
Feb 27 01:27:23 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5" returned: 1 in 0.583s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_6_wxnfb5' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7fc258-9aad-434d-99bf-0a7ae486e458]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD
Feb 27 01:27:23 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f7cae3e0-7e7f-40c3-bf56-c28948e22507" returned: 0 in 0.656s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-f7cae3e0-7e7f-40c3-bf56-c28948e22507" released by "delete_volume" :: held 1.439s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:23 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created reservations ['6c859976-1bc3-4fd6-8b89-2b62a2308b02', '65d9787e-0bbb-4299-a63c-9a5fbe60c741', 'da92002d-99b7-4947-a507-f117f394d2b2', '42136039-b38e-4d4a-922a-9028d75fe6bc'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:24 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d" returned: 0 in 0.574s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:24 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d is being set with open permissions: ugo+rw
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:24 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:24 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:24 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d
Feb 27 01:27:24 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:24 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 was qcow2, converting to raw {{(pid=83910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:24 devstack sudo[88361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:27:24 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:24 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d" returned: 0 in 0.447s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254012146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453c351e-d6e7-49df-b167-17acbece769e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:23Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Creating volume 453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:24 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:24 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:24 devstack sudo[88368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e 1073741824
Feb 27 01:27:24 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d68c9324-02bb-4ce7-ad90-90e4f23a5037 tempest-VolumesDeleteCascade-305291070 None] Create snapshot completed successfully
Feb 27 01:27:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Deleted volume successfully.
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b6fdfc26-d0ad-4be2-a7bd-90d9234f5211 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-f7cae3e0-7e7f-40c3-bf56-c28948e22507-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "cinder-quobyte-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead25b31-b4a0-4e06-a35e-6fbdac557ff5]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:24 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1
Feb 27 01:27:24 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:25 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 0 in 1.239s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_qbw3xh0fdevstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:27:25 devstack cinder-volume[83910]: INFO cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Converted 112.00 MB image at 90.31 MB/s
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:25 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e 1G
Feb 27 01:27:25 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-1bbc7963-b0eb-4699-984d-e97da3e96688-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:25 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e 1073741824" returned: 0 in 0.892s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-1bbc7963-b0eb-4699-984d-e97da3e96688-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:25 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Performing cascade delete. {{(pid=83910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 27 01:27:25 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-c362dcce-6aa7-4529-8a10-a54617d74744-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-c362dcce-6aa7-4529-8a10-a54617d74744-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:25 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1" returned: 0 in 0.735s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-c362dcce-6aa7-4529-8a10-a54617d74744" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-c362dcce-6aa7-4529-8a10-a54617d74744" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Deleting offline snapshot c362dcce-6aa7-4529-8a10-a54617d74744 of volume 1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:25 devstack sudo[88383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] snapshot_file for this snap is: volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:25 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d54f36-654d-43e9-896c-c64db6832f7e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:25 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:25 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e 1G" returned: 0 in 0.848s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.762s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c33f1b-7cf7-4906-8fec-894706eda6ee]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88903bc7-5ff7-4eb5-8d55-f5d7e51315d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453c351e-d6e7-49df-b167-17acbece769e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d062f2f0-52aa-4007-8f7b-d3c8f95daef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Volume volume-453c351e-d6e7-49df-b167-17acbece769e (453c351e-d6e7-49df-b167-17acbece769e): created successfully
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d062f2f0-52aa-4007-8f7b-d3c8f95daef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (da8a94c1-08d8-4bb9-84e7-84916d8523de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:26 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1" returned: 0 in 0.753s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-91c5cc6d-5af2-4fdd-92e5-4257559d2800 tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-quobyte-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1" released by "delete_volume" :: held 1.545s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:26 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:27:26 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Created reservations ['ecf23b68-0205-4977-9ef9-b313c6e7a69b', '601d441a-ba6d-47e5-b989-ffd4b4315cb6', '20bdc129-f4d6-4ca6-b26f-ac2db9affde0', '3d15b195-acc7-403c-b1f5-3d3b172ef261'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:26 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.871s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbc7963-b0eb-4699-984d-e97da3e96688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd1fbcf-3247-4f96-a111-1616849806ae]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:26 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 0 in 0.575s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:27:26 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.514s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:27 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Deleted volume successfully.
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ec5383bd-4b5d-4fd3-be37-d57e72bd0945 tempest-CreateVolumesFromSourceVolumeTest-1085224279 None] Lock "cinder-b97a5bf9-6d0f-4e4b-88dd-be99f91cb5c1-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:27 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.715s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ae5e7-c484-43d9-873b-9c49919865eb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:27 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d
Feb 27 01:27:27 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:27 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 1 in 0.907s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Downloaded image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 9ff640b2-7c53-4d99-8278-5624ed11c70e successfully. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 for user 0a9ca83b606b47b0842e84babdf8a4fd is deleted. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Marking volume 9ff640b2-7c53-4d99-8278-5624ed11c70e as bootable. {{(pid=83910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Copying metadata from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 to 9ff640b2-7c53-4d99-8278-5624ed11c70e. {{(pid=83910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Creating volume glance metadata for volume 9ff640b2-7c53-4d99-8278-5624ed11c70e backed by image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (ff8f9305-eab4-4c22-810a-fa6e4a08a70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e58194d-fb0a-461a-8fd8-f577416ebea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e58194d-fb0a-461a-8fd8-f577416ebea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-300610078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d6f170-6d53-4b89-a396-f6302d7f7970,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=453c351e-d6e7-49df-b167-17acbece769e,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:28Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8d8ca0-a3b8-497f-96da-ed7f14f0a496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8d8ca0-a3b8-497f-96da-ed7f14f0a496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846fe38-e240-4963-9f09-f5bb8d281504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846fe38-e240-4963-9f09-f5bb8d281504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '45d6f170-6d53-4b89-a396-f6302d7f7970', 'volume_name': 'volume-45d6f170-6d53-4b89-a396-f6302d7f7970', 'volume_size': 1, 'source_volid': '453c351e-d6e7-49df-b167-17acbece769e', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7322c6-61b4-4eac-afbb-ba87b3e3652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7322c6-61b4-4eac-afbb-ba87b3e3652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13575cf5-f1d0-49e2-b761-02719ed9fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:27 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Volume 45d6f170-6d53-4b89-a396-f6302d7f7970: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-45d6f170-6d53-4b89-a396-f6302d7f7970', 'volume_size': 1, 'source_volid': '453c351e-d6e7-49df-b167-17acbece769e', 'source_volstatus': 'available'}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:28 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Cloning volume 453c351e-d6e7-49df-b167-17acbece769e to volume 45d6f170-6d53-4b89-a396-f6302d7f7970
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Creating offline snapshot 37ab5870-a824-4b1c-91e3-8f4afc2d2166 of volume 453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceda74f8-fe34-4898-b7ab-a5e7e4495eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff640b2-7c53-4d99-8278-5624ed11c70e', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ada419b70>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78be7ff4-9156-44bc-9d7e-7278ec1250c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5fffff-af7e-4f96-9966-17f6e89a3e87]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:28 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Volume volume-9ff640b2-7c53-4d99-8278-5624ed11c70e (9ff640b2-7c53-4d99-8278-5624ed11c70e): created successfully
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78be7ff4-9156-44bc-9d7e-7278ec1250c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Flow 'volume_create_manager' (d1cf633c-0c20-41e2-b17d-02e208d74e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-cb2ab1c9-65be-4c9c-9770-379abc661ced tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Created volume successfully.
Feb 27 01:27:28 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:28 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:28 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d" returned: 0 in 0.896s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbc7963-b0eb-4699-984d-e97da3e96688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8bc198-55b9-4e89-945c-01ea9bb34ca4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:28 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:28 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:28 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.858s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:28 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 1G
Feb 27 01:27:28 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:28 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.753s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbc7963-b0eb-4699-984d-e97da3e96688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[552c64f9-336d-4eff-a762-8a82d5cba795]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:29 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:29 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 1G" returned: 0 in 0.603s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453c351e-d6e7-49df-b167-17acbece769e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:29 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453c351e-d6e7-49df-b167-17acbece769e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166
Feb 27 01:27:29 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.620s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:29 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:29 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (883f29af-e5e0-4bb4-b050-38594218947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b213cd1d-4a24-4232-ad0c-a9cee9d0059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b213cd1d-4a24-4232-ad0c-a9cee9d0059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-123610365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6c46a7-9147-4983-8285-aed76633039b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1da812ee5d94ce39a6d341b2df881da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:30Z,use_quota=True,user_id='f5bf9ab193f243e1983bca49240b7a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48152b17-6919-4949-b982-4343ca3b65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48152b17-6919-4949-b982-4343ca3b65cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019a9eab-91af-4485-a76a-2f220839fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019a9eab-91af-4485-a76a-2f220839fd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6c46a7-9147-4983-8285-aed76633039b', 'volume_name': 'volume-fb6c46a7-9147-4983-8285-aed76633039b', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e246d0-96f5-4345-b250-53b329bab325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e246d0-96f5-4345-b250-53b329bab325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cdf5e2-9d08-4e39-a6b3-3ebf29e5ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:29 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Volume fb6c46a7-9147-4983-8285-aed76633039b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6c46a7-9147-4983-8285-aed76633039b', 'volume_size': 1}
Feb 27 01:27:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:30 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453c351e-d6e7-49df-b167-17acbece769e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166" returned: 0 in 0.667s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:30 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 is being set with open permissions: ugo+rw
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166
Feb 27 01:27:30 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.834s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744
Feb 27 01:27:30 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:30 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166" returned: 0 in 0.456s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info
Feb 27 01:27:30 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:30 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.c362dcce-6aa7-4529-8a10-a54617d74744" returned: 0 in 0.480s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d -F qcow2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d -F qcow2
Feb 27 01:27:30 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info" returned: 0 in 0.500s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info is being set with open permissions: ugo+rw
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info
Feb 27 01:27:31 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.526s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:31 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbc7963-b0eb-4699-984d-e97da3e96688 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d -F qcow2" returned: 0 in 0.595s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-c362dcce-6aa7-4529-8a10-a54617d74744" released by "_delete_snapshot" :: held 5.908s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" released by "delete_snapshot" :: held 5.928s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Created reservations ['fa53adbb-8ee0-45f5-8faf-91f1777abe83', 'c0085eb8-52a6-496c-846f-133a6b23a688', 'b0cf1784-4a9f-4c0b-8414-d19083e8fd19', '1e516bd1-1bec-41f7-bd93-891d5f364a0f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:31 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Delete snapshot completed successfully.
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-c362dcce-6aa7-4529-8a10-a54617d74744-delete_snapshot" released by "delete_snapshot" :: held 6.063s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-cf2d4581-5a17-4137-9d63-fcf034f4064d-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-cf2d4581-5a17-4137-9d63-fcf034f4064d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-cf2d4581-5a17-4137-9d63-fcf034f4064d" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-cf2d4581-5a17-4137-9d63-fcf034f4064d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:31 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Deleting offline snapshot cf2d4581-5a17-4137-9d63-fcf034f4064d of volume 1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] snapshot_file for this snap is: volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.info" returned: 0 in 0.514s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-45d6f170-6d53-4b89-a396-f6302d7f7970" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a68bb27-79d6-40ae-bd00-3166b8c674b7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-45d6f170-6d53-4b89-a396-f6302d7f7970" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] snapshot: 37ab5870-a824-4b1c-91e3-8f4afc2d2166, volume: 45d6f170-6d53-4b89-a396-f6302d7f7970,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc021e97-564a-4c60-9c45-d59d256c5579]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d
Feb 27 01:27:31 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166
Feb 27 01:27:31 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d" returned: 0 in 0.587s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbc7963-b0eb-4699-984d-e97da3e96688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3c8439-8ee1-4103-a7e2-36ac09314d38]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack sudo[88486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:32 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166" returned: 0 in 0.660s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-453c351e-d6e7-49df-b167-17acbece769e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60316d4-f9c0-4784-8a66-111574e75fbc]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:32 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.640s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack sudo[88493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d
Feb 27 01:27:32 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:33 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.762s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:27:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970
Feb 27 01:27:33 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:33 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d" returned: 0 in 0.536s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d
Feb 27 01:27:33 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:34 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688.cf2d4581-5a17-4137-9d63-fcf034f4064d" returned: 0 in 1.111s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-cf2d4581-5a17-4137-9d63-fcf034f4064d" released by "_delete_snapshot" :: held 2.967s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" released by "delete_snapshot" :: held 2.992s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:UPDATE=263,cinder:SELECT=197,cinder:DELETE=28,cinder:INSERT=68 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=192,cinder:UPDATE=284,cinder:INSERT=72,cinder:DELETE=22 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Created reservations ['19052689-60ba-4db3-a815-4149a21a7156', '6dd32ecc-e358-4106-86c9-b00d76757de7', 'd58f060a-407d-46ba-84c9-090c9412c6e5', '35119b30-56e3-4a77-bf56-801828c4da2d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:34 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Delete snapshot completed successfully.
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-cf2d4581-5a17-4137-9d63-fcf034f4064d-delete_snapshot" released by "delete_snapshot" :: held 3.256s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Snapshots deleted, issuing volume delete {{(pid=83910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" acquired by "delete_volume" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[169620fa-1b45-481a-8ecf-4c1d8d3f2935]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:35 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:35 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:35 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970" returned: 0 in 2.529s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e47c851-3f7e-4be3-99b5-fb18bf583b91]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:35 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:35 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:35 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.939s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:35 devstack sudo[88525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688
Feb 27 01:27:35 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.635s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:27:36 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Converted 1024.00 MB image at 404.63 MB/s
Feb 27 01:27:36 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 is being set with open permissions: ugo+rw
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:36 devstack sudo[88531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970
Feb 27 01:27:36 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1bbc7963-b0eb-4699-984d-e97da3e96688" returned: 0 in 0.454s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-1bbc7963-b0eb-4699-984d-e97da3e96688" released by "delete_volume" :: held 1.482s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Created reservations ['3eb33ee2-15bf-4191-a55c-aa3ed5dccd76', 'b6a66731-a3d8-4f11-86d7-c8c5667977f2', '1a826ccf-e232-48e8-b529-86754134a8a9', 'b79b2cb4-851e-4a9e-b140-76f77a1e83c8'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:36 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:36 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-45d6f170-6d53-4b89-a396-f6302d7f7970" released by "_copy_volume_from_snapshot" :: held 5.096s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-37ab5870-a824-4b1c-91e3-8f4afc2d2166" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-37ab5870-a824-4b1c-91e3-8f4afc2d2166" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Deleting offline snapshot 37ab5870-a824-4b1c-91e3-8f4afc2d2166 of volume 453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] snapshot_file for this snap is: volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac1d089-2466-48f0-8f0e-f3a3752fb17a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:36 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166
Feb 27 01:27:36 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.454s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:36 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Deleted volume successfully.
Feb 27 01:27:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1a56ed08-7205-43f1-8ec5-c72e24e58dec tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-1bbc7963-b0eb-4699-984d-e97da3e96688-delete_volume" released by "delete_volume" :: held 11.505s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:37 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-453c351e-d6e7-49df-b167-17acbece769e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12c9b9-8cd8-434a-a4e9-7884584ff652]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:37 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:37 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Flow 'volume_create_manager' (ceee6f4f-b19c-4c8c-a5b0-872583b599a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8312bb-9da0-47ad-8a61-9023f548abc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8312bb-9da0-47ad-8a61-9023f548abc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1051965451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d642645-bacf-4e64-ab4c-ecf96adc8f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456f744baf6845ed9e0749d27dbdc291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='5817b867c36f42cd96927c5a1b56c398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e07cc0-3fba-40f8-bb9d-a030d4ac4159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e07cc0-3fba-40f8-bb9d-a030d4ac4159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f8e69-8372-44f3-9b80-c7472f5d753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f8e69-8372-44f3-9b80-c7472f5d753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d642645-bacf-4e64-ab4c-ecf96adc8f59', 'volume_name': 'volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1355ee-de2f-4e09-99fd-3f3c614e5aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1355ee-de2f-4e09-99fd-3f3c614e5aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8aee96b-62d5-41b1-9e6c-922c69d10364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Volume 4d642645-bacf-4e64-ab4c-ecf96adc8f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59', 'volume_size': 1}
Feb 27 01:27:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:38 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.641s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:38 devstack sudo[88548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166
Feb 27 01:27:38 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:38 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166" returned: 0 in 0.519s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:38 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166
Feb 27 01:27:38 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:38 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e.37ab5870-a824-4b1c-91e3-8f4afc2d2166" returned: 0 in 0.419s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-37ab5870-a824-4b1c-91e3-8f4afc2d2166" released by "_delete_snapshot" :: held 2.142s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.995s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.170s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-123610365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6c46a7-9147-4983-8285-aed76633039b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1da812ee5d94ce39a6d341b2df881da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:30Z,use_quota=True,user_id='f5bf9ab193f243e1983bca49240b7a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Creating volume fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:39 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13575cf5-f1d0-49e2-b761-02719ed9fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d6f170-6d53-4b89-a396-f6302d7f7970', 'volume_size': 1, 'source_volid': '453c351e-d6e7-49df-b167-17acbece769e', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:39 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b 1073741824
Feb 27 01:27:39 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c32274e-ba2a-49ce-ac10-4e8ad4715ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:39 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Volume volume-45d6f170-6d53-4b89-a396-f6302d7f7970 (45d6f170-6d53-4b89-a396-f6302d7f7970): created successfully
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c32274e-ba2a-49ce-ac10-4e8ad4715ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (ff8f9305-eab4-4c22-810a-fa6e4a08a70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bc69c7e3-f526-4deb-a533-6f08be4ab6e8 tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:27:39 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b 1073741824" returned: 0 in 0.504s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:39 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:27:39 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:39 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.413s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.472s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cdf5e2-9d08-4e39-a6b3-3ebf29e5ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6c46a7-9147-4983-8285-aed76633039b', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b4fa24-a301-46d8-bad2-6593c4a93014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f40ed-6f13-45b3-869c-cf15b242e3c8]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Volume volume-fb6c46a7-9147-4983-8285-aed76633039b (fb6c46a7-9147-4983-8285-aed76633039b): created successfully
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b4fa24-a301-46d8-bad2-6593c4a93014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (883f29af-e5e0-4bb4-b050-38594218947b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d16220ad-c567-4330-96a2-3f3bf0b3cea4 tempest-VolumeDependencyTests-1047019136 None] Created volume successfully.
Feb 27 01:27:40 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:27:40 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (6f499394-f194-4d97-b38d-5630417e3c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e860f7a-9c47-495e-97e5-836c97988ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e860f7a-9c47-495e-97e5-836c97988ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1866158748',display_name='tempest-VolumesGetTest-Volume-1008008343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307e7742-856a-41b2-8696-2432f648c317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:40Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168e2691-1240-48d5-a36a-c68277424c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168e2691-1240-48d5-a36a-c68277424c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e30ae81-ab91-44bd-b005-00d440de91f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e30ae81-ab91-44bd-b005-00d440de91f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307e7742-856a-41b2-8696-2432f648c317', 'volume_name': 'volume-307e7742-856a-41b2-8696-2432f648c317', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c246ea43-8d63-40cb-96e9-cb0a346dbc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c246ea43-8d63-40cb-96e9-cb0a346dbc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd1a8b8-d39e-4139-9294-53f55598e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Volume 307e7742-856a-41b2-8696-2432f648c317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307e7742-856a-41b2-8696-2432f648c317', 'volume_size': 1}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:40 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 0 in 0.587s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:40 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:27:40 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:41 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 1 in 0.488s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.108s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1051965451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d642645-bacf-4e64-ab4c-ecf96adc8f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456f744baf6845ed9e0749d27dbdc291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='5817b867c36f42cd96927c5a1b56c398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Creating volume 4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:41 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:41 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 1073741824
Feb 27 01:27:41 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9', 'name': 'volume-9ff640b2-7c53-4d99-8278-5624ed11c70e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87224210-1fad-4b20-9519-6dead11d412d', 'enforce_multipath': True} {{(pid=83910) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 01:27:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-d862845b-d0e3-411b-ab7f-191025574e30 req-af5ec285-ca4a-4981-aec6-0d3712cb1fa8 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] attachment_update completed successfully.
Feb 27 01:27:41 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 1073741824" returned: 0 in 0.531s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:41 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:27:41 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:42 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1866158748',display_name='tempest-VolumesGetTest-Volume-1008008343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307e7742-856a-41b2-8696-2432f648c317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:40Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Creating volume 307e7742-856a-41b2-8696-2432f648c317 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:42 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8aee96b-62d5-41b1-9e6c-922c69d10364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee1366a-7907-402d-9050-866353a8ffef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:42 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317 1073741824
Feb 27 01:27:42 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Volume volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 (4d642645-bacf-4e64-ab4c-ecf96adc8f59): created successfully
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee1366a-7907-402d-9050-866353a8ffef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Flow 'volume_create_manager' (ceee6f4f-b19c-4c8c-a5b0-872583b599a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c55faea1-5929-4a7f-9de1-83ac4120b97c tempest-VolumesDeleteCascade-305291070 None] Created volume successfully.
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:42 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317 1073741824" returned: 0 in 0.515s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:42 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317
Feb 27 01:27:42 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:43 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317" returned: 0 in 0.478s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.549s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd1a8b8-d39e-4139-9294-53f55598e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307e7742-856a-41b2-8696-2432f648c317', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54445e5d-3fc8-4a10-b5d2-2bbd641f3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:43 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Volume volume-307e7742-856a-41b2-8696-2432f648c317 (307e7742-856a-41b2-8696-2432f648c317): created successfully
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54445e5d-3fc8-4a10-b5d2-2bbd641f3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (6f499394-f194-4d97-b38d-5630417e3c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Creating offline snapshot 4ef7c65c-3bf9-481c-9e99-655ce6c591dc of volume fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-0bd38a31-eefa-4411-8845-37004502265a tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343ca25-c09e-4191-8555-d7b7a486d954]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:43 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:27:43 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-307e7742-856a-41b2-8696-2432f648c317-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Lock "cinder-307e7742-856a-41b2-8696-2432f648c317-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-307e7742-856a-41b2-8696-2432f648c317" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-307e7742-856a-41b2-8696-2432f648c317" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03523d-63ff-4c07-aa9a-f4e1132562b5]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:43 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317
Feb 27 01:27:43 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:43 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.619s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:43 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc 1G
Feb 27 01:27:43 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:44 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317" returned: 0 in 0.633s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:44 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317
Feb 27 01:27:44 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:44 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc 1G" returned: 0 in 0.569s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6c46a7-9147-4983-8285-aed76633039b -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:44 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6c46a7-9147-4983-8285-aed76633039b -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc
Feb 27 01:27:44 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:44 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-307e7742-856a-41b2-8696-2432f648c317" returned: 0 in 0.510s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-307e7742-856a-41b2-8696-2432f648c317" released by "delete_volume" :: held 1.173s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Created reservations ['7e29781b-b15c-4a0a-85ed-a1d6d7c5f0b3', '7ca34165-1a36-4f02-9dcb-606d58b9143a', '5b050a64-f743-4879-97a9-5e9fa3bb95d5', '19039832-0cb5-409a-9ce4-de84cee745f2'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:44 devstack sudo[88668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:44 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:44 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6c46a7-9147-4983-8285-aed76633039b -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:44 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc is being set with open permissions: ugo+rw
Feb 27 01:27:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:44 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc
Feb 27 01:27:44 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:45 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.464s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bbb24fdf-eb75-41b0-a530-784c062f1bff tempest-VolumesGetTest-1221146508 None] Lock "cinder-307e7742-856a-41b2-8696-2432f648c317-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:45 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc" returned: 0 in 0.451s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:45 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info
Feb 27 01:27:45 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:45 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info" returned: 0 in 0.475s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:45 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info is being set with open permissions: ugo+rw
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-45d6f170-6d53-4b89-a396-f6302d7f7970-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:45 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info
Feb 27 01:27:45 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Lock "cinder-45d6f170-6d53-4b89-a396-f6302d7f7970-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-45d6f170-6d53-4b89-a396-f6302d7f7970" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-45d6f170-6d53-4b89-a396-f6302d7f7970" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf81331-b0e1-4b5c-9a04-d5b94bfb9e12]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:46 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970
Feb 27 01:27:46 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:46 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.info" returned: 0 in 0.517s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.073s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Creating offline snapshot cc0d06e9-aa1d-4764-bdf2-952484ed1518 of volume 4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a5f1b9d5-e303-4bcf-ae1a-500573ed25ab tempest-VolumeDependencyTests-1047019136 None] Create snapshot completed successfully
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7a229-b03a-44af-8f66-203ab263aa38]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:46 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:27:46 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:46 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970" returned: 0 in 0.727s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:46 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970
Feb 27 01:27:46 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:47 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.699s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:47 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 1G
Feb 27 01:27:47 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:47 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (437184c9-1e8b-4e5a-91fc-6ded10fe5b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a85b3-cc8b-4638-b90e-902a09aa82b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-45d6f170-6d53-4b89-a396-f6302d7f7970" returned: 0 in 0.674s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a85b3-cc8b-4638-b90e-902a09aa82b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1126622938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64117825-9b73-4bc8-b29b-d4f4cfece675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1da812ee5d94ce39a6d341b2df881da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ef7c65c-3bf9-481c-9e99-655ce6c591dc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:47Z,use_quota=True,user_id='f5bf9ab193f243e1983bca49240b7a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062178ef-c6b6-4e9a-a7ca-574cb60e1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062178ef-c6b6-4e9a-a7ca-574cb60e1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc123ea-da61-45c9-b3ab-a341e021e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc123ea-da61-45c9-b3ab-a341e021e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64117825-9b73-4bc8-b29b-d4f4cfece675', 'volume_name': 'volume-64117825-9b73-4bc8-b29b-d4f4cfece675', 'volume_size': 1, 'snapshot_id': '4ef7c65c-3bf9-481c-9e99-655ce6c591dc'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7338b57-8ed5-4746-9225-3c5af445cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7338b57-8ed5-4746-9225-3c5af445cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e830b49b-a416-41aa-b779-761beaae8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:47 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Volume 64117825-9b73-4bc8-b29b-d4f4cfece675: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64117825-9b73-4bc8-b29b-d4f4cfece675', 'volume_size': 1, 'snapshot_id': '4ef7c65c-3bf9-481c-9e99-655ce6c591dc'}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-45d6f170-6d53-4b89-a396-f6302d7f7970" released by "delete_volume" :: held 1.482s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Created reservations ['f636cc99-2e6e-4b7f-96ee-6b81c5b5c0f5', 'b56e6060-291f-49f0-b88d-7318d9e5832d', 'cbe36815-20c9-489f-9a9a-afdd25e89328', '508fb055-0bbc-40ec-8499-69f1e47a0873'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:47 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:47 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:47 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 1G" returned: 0 in 0.667s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:47 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518
Feb 27 01:27:47 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:48 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.625s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9cdc0e83-0f14-4c08-8491-ffa8a20700c3 tempest-VolumesGetTest-1221146508 None] Lock "cinder-45d6f170-6d53-4b89-a396-f6302d7f7970-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-453c351e-d6e7-49df-b167-17acbece769e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Lock "cinder-453c351e-d6e7-49df-b167-17acbece769e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-453c351e-d6e7-49df-b167-17acbece769e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-453c351e-d6e7-49df-b167-17acbece769e" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1a2cb-0c08-4aa0-a444-d1dd2b8730d9]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:48 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:48 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:48 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518" returned: 0 in 0.845s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:48 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 is being set with open permissions: ugo+rw
Feb 27 01:27:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:48 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518
Feb 27 01:27:48 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:49 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.747s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:49 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e
Feb 27 01:27:49 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:49 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:49 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info
Feb 27 01:27:49 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:49 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-453c351e-d6e7-49df-b167-17acbece769e" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-453c351e-d6e7-49df-b167-17acbece769e" released by "delete_volume" :: held 1.287s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Created reservations ['c7a44430-0675-4447-87c7-5b9e516dccd3', 'd1b7bde5-644a-431e-a5be-a5dc2ccf1098', 'c8731df7-5715-487e-8fc7-5f4d9f3346a2', '4f619498-4191-459c-85f4-a3f638531428'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:49 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info" returned: 0 in 0.491s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:49 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info is being set with open permissions: ugo+rw
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:49 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info
Feb 27 01:27:49 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:49 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:27:49 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:50 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:50 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-847e777d-e680-4e35-bdc2-ef1e81913c79 tempest-VolumesGetTest-1221146508 None] Lock "cinder-453c351e-d6e7-49df-b167-17acbece769e-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:50 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.info" returned: 0 in 0.582s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.912s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.887s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-4ef7c65c-3bf9-481c-9e99-655ce6c591dc-64117825-9b73-4bc8-b29b-d4f4cfece675" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-4ef7c65c-3bf9-481c-9e99-655ce6c591dc-64117825-9b73-4bc8-b29b-d4f4cfece675" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Creating volume 64117825-9b73-4bc8-b29b-d4f4cfece675 from snapshot 4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-64117825-9b73-4bc8-b29b-d4f4cfece675" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:50 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-91a393f2-6633-4bcb-8682-3b5678abce13 tempest-VolumesDeleteCascade-305291070 None] Create snapshot completed successfully
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-64117825-9b73-4bc8-b29b-d4f4cfece675" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] snapshot: 4ef7c65c-3bf9-481c-9e99-655ce6c591dc, volume: 64117825-9b73-4bc8-b29b-d4f4cfece675,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa639ddb-5b3b-4963-9739-9a4edb874e5d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:50 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc
Feb 27 01:27:50 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:51 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc" returned: 0 in 0.629s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6c46a7-9147-4983-8285-aed76633039b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff0e09e-760a-4d56-ba2d-0f61f6a42a8a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:51 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:27:51 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Flow 'volume_create_manager' (fa2fbf22-cfc8-4b9f-aa9a-93a5b12808ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9eec87-de51-4105-adb2-fbf0fd516dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9eec87-de51-4105-adb2-fbf0fd516dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-34131541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7807b241-ac60-4e94-80ae-96a5ebc2ccc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456f744baf6845ed9e0749d27dbdc291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc0d06e9-aa1d-4764-bdf2-952484ed1518,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:51Z,use_quota=True,user_id='5817b867c36f42cd96927c5a1b56c398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ad8bbc-6ecb-4d73-b6cd-a0a66a658588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ad8bbc-6ecb-4d73-b6cd-a0a66a658588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a59e1f-1a2c-4ab2-b648-45489c9888f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a59e1f-1a2c-4ab2-b648-45489c9888f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7807b241-ac60-4e94-80ae-96a5ebc2ccc4', 'volume_name': 'volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4', 'volume_size': 1, 'snapshot_id': 'cc0d06e9-aa1d-4764-bdf2-952484ed1518'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e159803-4474-44ea-9bb2-f512c81b9607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e159803-4474-44ea-9bb2-f512c81b9607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9249cf-fdc5-4c2e-a490-383abb89a155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Volume 7807b241-ac60-4e94-80ae-96a5ebc2ccc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4', 'volume_size': 1, 'snapshot_id': 'cc0d06e9-aa1d-4764-bdf2-952484ed1518'}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (cab9048a-bc9f-46c3-ac8f-166a13d74cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72caf4e-0e82-4457-a702-50e0be3657a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72caf4e-0e82-4457-a702-50e0be3657a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809714654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f38551-25f2-42ae-a30c-9a8fb0437a2a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:51Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fe5aba-2c62-423c-b172-32193b9958a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fe5aba-2c62-423c-b172-32193b9958a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a3383c-2513-454e-b118-42dbda7154cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.image.glance [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Creating Keystone auth plugin from conf {{(pid=83910) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a3383c-2513-454e-b118-42dbda7154cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54f38551-25f2-42ae-a30c-9a8fb0437a2a', 'volume_name': 'volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ad9c513f0>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73246733-ff27-4c6b-8410-f11cdc67fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73246733-ff27-4c6b-8410-f11cdc67fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e34295-ee1b-4a70-844f-444ef6e22488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Volume 54f38551-25f2-42ae-a30c-9a8fb0437a2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ad9c513f0>}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Trying to clone 54f38551-25f2-42ae-a30c-9a8fb0437a2a from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]). {{(pid=83910) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:27:51 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.674s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:51 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675
Feb 27 01:27:51 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:27:51 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d5e1d-f507-4b8e-9549-95cee6feef5d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:51 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD
Feb 27 01:27:51 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:53 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD" returned: 0 in 1.251s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:53 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 is fetched for user 1eb1fdccec9b436a8c88b2024d93fde5. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:27:53 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[97537c99-35db-4887-a927-e113352a9551]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:53 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD
Feb 27 01:27:53 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:54 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675" returned: 0 in 2.766s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:54 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72f8c58-4aa7-46c8-866b-878e985ddc02]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:54 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:27:54 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:54 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD" returned: 0 in 1.435s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:55 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.607s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b, size 1024.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:27:55 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Converted 1024.00 MB image at 370.11 MB/s
Feb 27 01:27:55 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 is being set with open permissions: ugo+rw
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:55 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675
Feb 27 01:27:55 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:55 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675" returned: 0 in 0.419s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-64117825-9b73-4bc8-b29b-d4f4cfece675" released by "_copy_volume_from_snapshot" :: held 5.182s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-4ef7c65c-3bf9-481c-9e99-655ce6c591dc-64117825-9b73-4bc8-b29b-d4f4cfece675" released by "_create_volume_from_snapshot" :: held 5.205s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.225s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.262s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-cc0d06e9-aa1d-4764-bdf2-952484ed1518-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-cc0d06e9-aa1d-4764-bdf2-952484ed1518-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Creating volume 7807b241-ac60-4e94-80ae-96a5ebc2ccc4 from snapshot cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e830b49b-a416-41aa-b779-761beaae8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64117825-9b73-4bc8-b29b-d4f4cfece675', 'volume_size': 1, 'snapshot_id': '4ef7c65c-3bf9-481c-9e99-655ce6c591dc'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd022c2-1672-47ca-8909-08c5445d14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] snapshot: cc0d06e9-aa1d-4764-bdf2-952484ed1518, volume: 7807b241-ac60-4e94-80ae-96a5ebc2ccc4,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:27:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Volume volume-64117825-9b73-4bc8-b29b-d4f4cfece675 (64117825-9b73-4bc8-b29b-d4f4cfece675): created successfully
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd022c2-1672-47ca-8909-08c5445d14a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (437184c9-1e8b-4e5a-91fc-6ded10fe5b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d023bf15-c866-460d-ae4e-4ed4c7694a4a tempest-VolumeDependencyTests-1047019136 None] Created volume successfully.
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec06803-9d52-4115-9de5-f5a22660acba]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:55 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518
Feb 27 01:27:55 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-4ef7c65c-3bf9-481c-9e99-655ce6c591dc-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-4ef7c65c-3bf9-481c-9e99-655ce6c591dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-fb6c46a7-9147-4983-8285-aed76633039b" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-fb6c46a7-9147-4983-8285-aed76633039b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-4ef7c65c-3bf9-481c-9e99-655ce6c591dc" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-4ef7c65c-3bf9-481c-9e99-655ce6c591dc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Deleting offline snapshot 4ef7c65c-3bf9-481c-9e99-655ce6c591dc of volume fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] snapshot_file for this snap is: volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec12dcbd-31ae-4cdc-a088-55f229ab6cb8]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efad1f-bb19-4b4d-9908-a1ce0624bfbf]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc
Feb 27 01:27:56 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:27:56 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc" returned: 0 in 0.523s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6c46a7-9147-4983-8285-aed76633039b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057b4c3-3815-44ad-b28c-ec84ec989b03]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:27:56 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.545s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:27:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4
Feb 27 01:27:56 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:57 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:57 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc
Feb 27 01:27:57 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:58 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc" returned: 0 in 1.387s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:58 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc
Feb 27 01:27:58 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:59 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" returned: 0 in 2.858s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[840d522b-f26e-4b35-b8ad-15df6230318b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:59 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b.4ef7c65c-3bf9-481c-9e99-655ce6c591dc" returned: 0 in 1.089s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-4ef7c65c-3bf9-481c-9e99-655ce6c591dc" released by "_delete_snapshot" :: held 3.616s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-fb6c46a7-9147-4983-8285-aed76633039b" released by "delete_snapshot" :: held 3.643s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:59 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:27:59 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Created reservations ['3484a7fa-fdfa-44e3-ab92-780d67896c36', '0d4ac622-c118-4ed3-a77d-f8f5ff66a666', 'a8d17609-7f28-4183-a4cc-9e730d377d12', '51c974e2-a800-4188-81d6-960d5e329bec'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:59 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Delete snapshot completed successfully.
Feb 27 01:27:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5d033350-20d0-4950-8714-c6a0434d298b tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-4ef7c65c-3bf9-481c-9e99-655ce6c591dc-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-fb6c46a7-9147-4983-8285-aed76633039b-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-fb6c46a7-9147-4983-8285-aed76633039b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-fb6c46a7-9147-4983-8285-aed76633039b" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-fb6c46a7-9147-4983-8285-aed76633039b" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06df2e-62ba-40a0-a66f-73d33a0fc60e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:00 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.835s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59, size 1024.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:00 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Converted 1024.00 MB image at 358.08 MB/s
Feb 27 01:28:00 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 is being set with open permissions: ugo+rw
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:00 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4
Feb 27 01:28:00 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:00 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:28:00 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:00 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" returned: 0 in 0.427s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" released by "_copy_volume_from_snapshot" :: held 5.295s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-cc0d06e9-aa1d-4764-bdf2-952484ed1518-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" released by "_create_volume_from_snapshot" :: held 5.325s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.346s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.291s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809714654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f38551-25f2-42ae-a30c-9a8fb0437a2a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:51Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Creating volume 54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:00 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:00 devstack sudo[88921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a 1073741824
Feb 27 01:28:00 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:00 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.538s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:01 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b
Feb 27 01:28:01 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9249cf-fdc5-4c2e-a490-383abb89a155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4', 'volume_size': 1, 'snapshot_id': 'cc0d06e9-aa1d-4764-bdf2-952484ed1518'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f75c1a-a21f-4d1c-8489-69d4f2e33a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:01 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Volume volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 (7807b241-ac60-4e94-80ae-96a5ebc2ccc4): created successfully
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f75c1a-a21f-4d1c-8489-69d4f2e33a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Flow 'volume_create_manager' (fa2fbf22-cfc8-4b9f-aa9a-93a5b12808ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:01 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-aa61253d-4710-4bc3-ace6-6567e7eca6a0 tempest-VolumesDeleteCascade-305291070 None] Created volume successfully.
Feb 27 01:28:01 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fb6c46a7-9147-4983-8285-aed76633039b" returned: 0 in 0.504s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-fb6c46a7-9147-4983-8285-aed76633039b" released by "delete_volume" :: held 1.079s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Created reservations ['5aeef7ef-00b4-415b-9b6d-d6f4e62b084d', 'd38d1ab4-ea13-48fc-91d2-81025d917d9b', '56902253-b1b5-4e69-816f-5bc58d866313', '073f91e2-9184-4515-b126-06b698825717'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:01 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a 1073741824" returned: 0 in 0.651s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:01 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:01 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:01 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:01 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:02 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:02 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.491s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Attempting download of 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 54f38551-25f2-42ae-a30c-9a8fb0437a2a. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:28:02 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Deleted volume successfully.
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c4c41589-6a5a-4f5d-93d7-1c87a9c97893 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-fb6c46a7-9147-4983-8285-aed76633039b-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e2bc39-cb89-4c29-a4ce-03e84aba55bb]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-4d642645-bacf-4e64-ab4c-ecf96adc8f59-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-4d642645-bacf-4e64-ab4c-ecf96adc8f59-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Performing cascade delete. {{(pid=83910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-cc0d06e9-aa1d-4764-bdf2-952484ed1518-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-cc0d06e9-aa1d-4764-bdf2-952484ed1518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-4d642645-bacf-4e64-ab4c-ecf96adc8f59" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-4d642645-bacf-4e64-ab4c-ecf96adc8f59" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-cc0d06e9-aa1d-4764-bdf2-952484ed1518" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-cc0d06e9-aa1d-4764-bdf2-952484ed1518" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:02 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql
Feb 27 01:28:02 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Deleting offline snapshot cc0d06e9-aa1d-4764-bdf2-952484ed1518 of volume 4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] snapshot_file for this snap is: volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf7cb22-a1b8-4f94-83ff-6a54119371e6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:02 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518
Feb 27 01:28:02 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:02 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql" returned: 0 in 0.653s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (4bfce136-b747-4e53-bd59-8f297d6f956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e930018-4288-4ec3-9e45-bf47071f2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e930018-4288-4ec3-9e45-bf47071f2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-906435009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a0fa10-f204-43d9-a13c-c1569270687e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1da812ee5d94ce39a6d341b2df881da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:03Z,use_quota=True,user_id='f5bf9ab193f243e1983bca49240b7a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd50f30-85a1-42bd-b323-b35fb7f62430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd50f30-85a1-42bd-b323-b35fb7f62430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2cdc59-3988-4967-82d2-a5201c39505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2cdc59-3988-4967-82d2-a5201c39505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a0fa10-f204-43d9-a13c-c1569270687e', 'volume_name': 'volume-e2a0fa10-f204-43d9-a13c-c1569270687e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7606ecd-f933-4e14-b803-2292dc06c085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7606ecd-f933-4e14-b803-2292dc06c085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack sudo[88941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql
Feb 27 01:28:03 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38492b39-6fbf-438e-8de9-f97f37ac7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Volume e2a0fa10-f204-43d9-a13c-c1569270687e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a0fa10-f204-43d9-a13c-c1569270687e', 'volume_size': 1}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-906435009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a0fa10-f204-43d9-a13c-c1569270687e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1da812ee5d94ce39a6d341b2df881da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:03Z,use_quota=True,user_id='f5bf9ab193f243e1983bca49240b7a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Creating volume e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:03 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518" returned: 0 in 0.735s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:28:03 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e 1073741824
Feb 27 01:28:03 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57064ac-69b6-4cd6-9a20-5a990e55ef01]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:28:03 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql" returned: 1 in 0.752s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_95_0wrql' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d313b82-076d-44a2-8a58-3b3e6778a69a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.589s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e 1073741824" returned: 0 in 0.653s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:03 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518
Feb 27 01:28:03 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD
Feb 27 01:28:03 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:03 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:04 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518" returned: 0 in 0.494s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:04 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.486s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:04 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 was qcow2, converting to raw {{(pid=83910) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:04 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518
Feb 27 01:28:04 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38492b39-6fbf-438e-8de9-f97f37ac7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a0fa10-f204-43d9-a13c-c1569270687e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fbe9f3-806b-4adc-972b-a5e588fae782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:04 devstack sudo[88980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:04 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:04 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Volume volume-e2a0fa10-f204-43d9-a13c-c1569270687e (e2a0fa10-f204-43d9-a13c-c1569270687e): created successfully
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fbe9f3-806b-4adc-972b-a5e588fae782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (4bfce136-b747-4e53-bd59-8f297d6f956d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:04 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ee7c12e9-0ea4-4be8-88fa-dfcccd88d07c tempest-VolumeDependencyTests-1047019136 None] Created volume successfully.
Feb 27 01:28:04 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59.cc0d06e9-aa1d-4764-bdf2-952484ed1518" returned: 0 in 0.649s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-cc0d06e9-aa1d-4764-bdf2-952484ed1518" released by "_delete_snapshot" :: held 2.549s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-4d642645-bacf-4e64-ab4c-ecf96adc8f59" released by "delete_snapshot" :: held 2.565s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Created reservations ['ab0cade6-5490-4970-b658-6132a318f04c', '8b32b699-addb-4e04-a4fb-76944ff975a8', '22412c2c-2047-4f03-9b71-b10f22182d78', '6cfdd02a-7b99-4731-b8af-ce66b3347484'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:04 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Delete snapshot completed successfully.
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-cc0d06e9-aa1d-4764-bdf2-952484ed1518-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Snapshots deleted, issuing volume delete {{(pid=83910) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-4d642645-bacf-4e64-ab4c-ecf96adc8f59" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-4d642645-bacf-4e64-ab4c-ecf96adc8f59" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[90096e22-bd37-4904-96c1-7682c837a9ea]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:05 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:28:05 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (f4002d83-432c-4d57-b1c2-84a4d3feb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab94b56-978c-4838-893f-fbc435f468b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab94b56-978c-4838-893f-fbc435f468b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-245818307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838868f5-b447-4e0b-9694-de0da6c0a17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1da812ee5d94ce39a6d341b2df881da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e2a0fa10-f204-43d9-a13c-c1569270687e,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:05Z,use_quota=True,user_id='f5bf9ab193f243e1983bca49240b7a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11097b41-0130-426c-af16-f4d4570655d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11097b41-0130-426c-af16-f4d4570655d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cb3342-15d9-4220-9e44-54f65253f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cb3342-15d9-4220-9e44-54f65253f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '838868f5-b447-4e0b-9694-de0da6c0a17b', 'volume_name': 'volume-838868f5-b447-4e0b-9694-de0da6c0a17b', 'volume_size': 1, 'source_volid': 'e2a0fa10-f204-43d9-a13c-c1569270687e', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb8280a-b00e-4900-8fc3-d7aa28175c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb8280a-b00e-4900-8fc3-d7aa28175c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35217056-2a14-4846-868c-5cabf80a9f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Volume 838868f5-b447-4e0b-9694-de0da6c0a17b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-838868f5-b447-4e0b-9694-de0da6c0a17b', 'volume_size': 1, 'source_volid': 'e2a0fa10-f204-43d9-a13c-c1569270687e', 'source_volstatus': 'available'}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:05 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Cloning volume e2a0fa10-f204-43d9-a13c-c1569270687e to volume 838868f5-b447-4e0b-9694-de0da6c0a17b
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Creating offline snapshot 9435a2b1-91e6-4b7f-ae78-a117d23f9abb of volume e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4d3b9-3395-45a6-83f0-2e43306ed08e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:05 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 0 in 1.463s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08cccc7f-a20e-4cbd-bfed-5f8476c9a973_et_9xv8adevstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:05 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Converted 112.00 MB image at 76.48 MB/s
Feb 27 01:28:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:05 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:05 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:05 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a 1G
Feb 27 01:28:05 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.919s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:06 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59
Feb 27 01:28:06 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.797s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:06 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb 1G
Feb 27 01:28:06 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a 1G" returned: 0 in 0.744s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c6a440-dfc0-4d35-af71-c5a94a9068d4]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:06 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4d642645-bacf-4e64-ab4c-ecf96adc8f59" returned: 0 in 0.583s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-4d642645-bacf-4e64-ab4c-ecf96adc8f59" released by "delete_volume" :: held 1.629s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:06 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:06 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Created reservations ['4d5bf852-4f4a-4511-9e62-c1ad713952a4', '73af9e28-8fdc-479e-a186-70f5d4e434c1', 'abb33174-0de7-44ac-a7f3-d622c7a08a4f', 'e550587e-2ad9-47bf-9fc7-71894758e932'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:06 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:06 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:07 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb 1G" returned: 0 in 0.744s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a0fa10-f204-43d9-a13c-c1569270687e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:07 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a0fa10-f204-43d9-a13c-c1569270687e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb
Feb 27 01:28:07 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:07 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 0 in 0.669s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:07 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.534s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Deleted volume successfully.
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6eb955cb-6357-45b2-ba1e-4398bcceedb4 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-4d642645-bacf-4e64-ab4c-ecf96adc8f59-delete_volume" released by "delete_volume" :: held 5.036s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:07 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:07 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-7807b241-ac60-4e94-80ae-96a5ebc2ccc4-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-7807b241-ac60-4e94-80ae-96a5ebc2ccc4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:07 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a0fa10-f204-43d9-a13c-c1569270687e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb" returned: 0 in 0.842s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb is being set with open permissions: ugo+rw
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "cinder-quobyte-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:07 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 1 in 0.799s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Downloaded image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 ((None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}])) to volume 54f38551-25f2-42ae-a30c-9a8fb0437a2a successfully. {{(pid=83910) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Temporary image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 for user 1eb1fdccec9b436a8c88b2024d93fde5 is deleted. {{(pid=83910) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.volume.volume_utils [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Marking volume 54f38551-25f2-42ae-a30c-9a8fb0437a2a as bootable. {{(pid=83910) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Copying metadata from image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 to 54f38551-25f2-42ae-a30c-9a8fb0437a2a. {{(pid=83910) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:28:07 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Creating volume glance metadata for volume 54f38551-25f2-42ae-a30c-9a8fb0437a2a backed by image 08cccc7f-a20e-4cbd-bfed-5f8476c9a973 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83910) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" acquired by "delete_volume" :: waited 0.030s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:08 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb
Feb 27 01:28:08 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0c653-7533-4ce3-a098-f5bbb20abd54]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e34295-ee1b-4a70-844f-444ef6e22488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a', 'volume_size': 1, 'image_id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b857ad08a5a4e38859a9562c73d27f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08cccc7f-a20e-4cbd-bfed-5f8476c9a973', 'created_at': datetime.datetime(2026, 2, 27, 0, 18, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 18, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08cccc7f-a20e-4cbd-bfed-5f8476c9a973/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3ad9c513f0>}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf91ea51-15da-405d-820f-9b2c4c9e1c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Volume volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a (54f38551-25f2-42ae-a30c-9a8fb0437a2a): created successfully
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf91ea51-15da-405d-820f-9b2c4c9e1c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (cab9048a-bc9f-46c3-ac8f-166a13d74cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-7759fdce-e1ec-4779-ac93-aea608893d83 tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:28:08 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4
Feb 27 01:28:08 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:08 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb" returned: 0 in 0.543s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:08 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info
Feb 27 01:28:08 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:08 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" returned: 0 in 0.692s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:08 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4
Feb 27 01:28:08 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:09 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info" returned: 0 in 0.689s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:09 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info is being set with open permissions: ugo+rw
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:09 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info
Feb 27 01:28:09 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:09 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (2013fca5-7e46-4bf8-8e4d-c8e069e4e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ac8eb5-f209-48fd-9211-04356fa4e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" returned: 0 in 0.655s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ac8eb5-f209-48fd-9211-04356fa4e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1512998775',display_name='tempest-VolumesGetTest-Volume-2022428707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777070b4-356b-4626-a515-df6a21702d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:09Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94195269-ea9d-4e10-af1d-d2be8d22f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94195269-ea9d-4e10-af1d-d2be8d22f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9727dd5-1d99-4eb7-bd6b-2a996bf79b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9727dd5-1d99-4eb7-bd6b-2a996bf79b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777070b4-356b-4626-a515-df6a21702d5f', 'volume_name': 'volume-777070b4-356b-4626-a515-df6a21702d5f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194c7154-c43c-46f0-8087-d0ab55943a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194c7154-c43c-46f0-8087-d0ab55943a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db2a265-0cc2-4ae1-9b16-b64816426490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:09 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Volume 777070b4-356b-4626-a515-df6a21702d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777070b4-356b-4626-a515-df6a21702d5f', 'volume_size': 1}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-quobyte-7807b241-ac60-4e94-80ae-96a5ebc2ccc4" released by "delete_volume" :: held 1.428s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Created reservations ['cf038653-c2d7-4a91-9967-f65cfce81117', '70e496ea-f570-4d0b-8845-1ef5e3cb4f80', '890f6c1f-b097-40e7-8004-fe3d4d9a4d91', 'dd330c8d-0fa1-4f62-a481-213aa7c2d4c9'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:09 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:09 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:09 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.info" returned: 0 in 0.581s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-838868f5-b447-4e0b-9694-de0da6c0a17b" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-838868f5-b447-4e0b-9694-de0da6c0a17b" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] snapshot: 9435a2b1-91e6-4b7f-ae78-a117d23f9abb, volume: 838868f5-b447-4e0b-9694-de0da6c0a17b,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49f413-5604-4859-aac8-98ebf62aba1e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:09 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb
Feb 27 01:28:09 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:10 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:10 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Deleted volume successfully.
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-47d1a3c5-4578-4f64-aaea-5032b01a9bc7 tempest-VolumesDeleteCascade-305291070 None] Lock "cinder-7807b241-ac60-4e94-80ae-96a5ebc2ccc4-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:10 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb" returned: 0 in 0.687s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a0fa10-f204-43d9-a13c-c1569270687e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c29b6c-1e6d-4f1d-8615-3314d5bdc2a6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:10 devstack sudo[89130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:10 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:11 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.598s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:11 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:28:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:11 devstack sudo[89135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b
Feb 27 01:28:11 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-21d8c303-afed-43c8-a025-344d07355b57 req-4c060f51-dc55-4ed2-952c-3cb21435cb07 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Terminate volume connection completed successfully.
Feb 27 01:28:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-21d8c303-afed-43c8-a025-344d07355b57 req-4c060f51-dc55-4ed2-952c-3cb21435cb07 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Deleting attachment 87224210-1fad-4b20-9519-6dead11d412d. {{(pid=83910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 01:28:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "cinder-9ff640b2-7c53-4d99-8278-5624ed11c70e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-9ff640b2-7c53-4d99-8278-5624ed11c70e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "cinder-quobyte-9ff640b2-7c53-4d99-8278-5624ed11c70e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-quobyte-9ff640b2-7c53-4d99-8278-5624ed11c70e" acquired by "delete_volume" :: waited 0.026s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0fef3b-ee83-4e31-9a92-9a5db7df54a5]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:13 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:28:13 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Flow 'volume_create_manager' (99cd57fa-f5ed-454d-873d-737846f80fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd00fba0-3b4c-439c-bf19-49cc1a78e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd00fba0-3b4c-439c-bf19-49cc1a78e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1758706351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67be4f26-b1a6-4585-87fc-77c19f15f900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d51f28298d47d1a01d71e5e5b6d48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:13Z,use_quota=True,user_id='f9d2aa6c695c424583593879aee7db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9186fe3e-4e4a-49f7-add2-0872fbdbceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9186fe3e-4e4a-49f7-add2-0872fbdbceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d48fb6d-2294-41d7-af56-a487b6f9258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d48fb6d-2294-41d7-af56-a487b6f9258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67be4f26-b1a6-4585-87fc-77c19f15f900', 'volume_name': 'volume-67be4f26-b1a6-4585-87fc-77c19f15f900', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e140d981-7034-45df-9a08-a645addc27ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e140d981-7034-45df-9a08-a645addc27ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb26e7f-00ec-4885-a7da-4e0d6653b3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:13 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Volume 67be4f26-b1a6-4585-87fc-77c19f15f900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67be4f26-b1a6-4585-87fc-77c19f15f900', 'volume_size': 1}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:13 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b" returned: 0 in 2.400s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b5519-a926-48e9-b183-8b744898a039]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:13 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:13 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:13 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 0 in 0.937s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:13 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:28:13 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:14 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 1 in 0.496s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:14 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.633s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:14 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Converted 1024.00 MB image at 426.55 MB/s
Feb 27 01:28:14 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e
Feb 27 01:28:14 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b is being set with open permissions: ugo+rw
Feb 27 01:28:14 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:14 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b
Feb 27 01:28:14 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:14 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9ff640b2-7c53-4d99-8278-5624ed11c70e" returned: 0 in 0.420s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-quobyte-9ff640b2-7c53-4d99-8278-5624ed11c70e" released by "delete_volume" :: held 1.980s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.quota [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Created reservations ['aa624f11-8e1c-46f6-8cf9-7989f8e9441d', '18fdf0b8-2282-4e3a-8d48-9883e7f14e80', '7dcb0b5a-bfb3-45b7-8a1c-bd473ee6fd56', '599eafd5-31c9-40bf-9f6f-c4e31374c469'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:14 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b" returned: 0 in 0.480s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-838868f5-b447-4e0b-9694-de0da6c0a17b" released by "_copy_volume_from_snapshot" :: held 4.866s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-9435a2b1-91e6-4b7f-ae78-a117d23f9abb" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-9435a2b1-91e6-4b7f-ae78-a117d23f9abb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Deleting offline snapshot 9435a2b1-91e6-4b7f-ae78-a117d23f9abb of volume e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] snapshot_file for this snap is: volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134892f-e188-4549-b381-5f9cca95bdb4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:14 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:14 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:14 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb
Feb 27 01:28:14 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:15 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.543s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG cinder.manager [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:15 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb" returned: 0 in 0.607s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a0fa10-f204-43d9-a13c-c1569270687e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:28:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Deleted volume successfully.
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba07d8-ab86-4d31-9289-6cf91d23af91]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-21d8c303-afed-43c8-a025-344d07355b57 req-e8a730a8-7526-4bef-b15a-cb7d7679a876 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-9ff640b2-7c53-4d99-8278-5624ed11c70e-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:15 devstack sudo[89175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:15 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:15 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.563s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:15 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb
Feb 27 01:28:15 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:16 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:16 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb
Feb 27 01:28:16 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:16 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e.9435a2b1-91e6-4b7f-ae78-a117d23f9abb" returned: 0 in 0.542s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-9435a2b1-91e6-4b7f-ae78-a117d23f9abb" released by "_delete_snapshot" :: held 2.277s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.568s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.641s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1512998775',display_name='tempest-VolumesGetTest-Volume-2022428707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777070b4-356b-4626-a515-df6a21702d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8abe0473c542cdb969e88e13ae5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:09Z,use_quota=True,user_id='1eb1fdccec9b436a8c88b2024d93fde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Creating volume 777070b4-356b-4626-a515-df6a21702d5f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:17 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35217056-2a14-4846-868c-5cabf80a9f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838868f5-b447-4e0b-9694-de0da6c0a17b', 'volume_size': 1, 'source_volid': 'e2a0fa10-f204-43d9-a13c-c1569270687e', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e20ba41-7c91-4862-b951-46615edb8a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:17 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f 1073741824
Feb 27 01:28:17 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:17 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Volume volume-838868f5-b447-4e0b-9694-de0da6c0a17b (838868f5-b447-4e0b-9694-de0da6c0a17b): created successfully
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e20ba41-7c91-4862-b951-46615edb8a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Flow 'volume_create_manager' (f4002d83-432c-4d57-b1c2-84a4d3feb634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-74910c35-fde0-4439-9fa6-a228a257e435 tempest-VolumeDependencyTests-1047019136 None] Created volume successfully.
Feb 27 01:28:17 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f 1073741824" returned: 0 in 0.523s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:17 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f
Feb 27 01:28:17 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:18 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f" returned: 0 in 0.473s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.551s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1758706351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67be4f26-b1a6-4585-87fc-77c19f15f900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d51f28298d47d1a01d71e5e5b6d48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:13Z,use_quota=True,user_id='f9d2aa6c695c424583593879aee7db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Creating volume 67be4f26-b1a6-4585-87fc-77c19f15f900 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:18 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db2a265-0cc2-4ae1-9b16-b64816426490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777070b4-356b-4626-a515-df6a21702d5f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b499860-616d-471a-8569-1da4e369a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:18 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Volume volume-777070b4-356b-4626-a515-df6a21702d5f (777070b4-356b-4626-a515-df6a21702d5f): created successfully
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b499860-616d-471a-8569-1da4e369a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Flow 'volume_create_manager' (2013fca5-7e46-4bf8-8e4d-c8e069e4e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:18 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8831e354-be6c-4a94-a2ef-f8cf20a7e2b5 tempest-VolumesGetTest-1221146508 None] Created volume successfully.
Feb 27 01:28:18 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900 1073741824
Feb 27 01:28:18 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-e2a0fa10-f204-43d9-a13c-c1569270687e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-e2a0fa10-f204-43d9-a13c-c1569270687e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-e2a0fa10-f204-43d9-a13c-c1569270687e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-e2a0fa10-f204-43d9-a13c-c1569270687e" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5843e3fa-07fb-4d5b-859b-2e36bc9f461d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:18 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:18 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:18 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900 1073741824" returned: 0 in 0.649s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:18 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900
Feb 27 01:28:18 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:18 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.591s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:18 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e
Feb 27 01:28:18 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-777070b4-356b-4626-a515-df6a21702d5f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Lock "cinder-777070b4-356b-4626-a515-df6a21702d5f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-777070b4-356b-4626-a515-df6a21702d5f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-777070b4-356b-4626-a515-df6a21702d5f" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e318b-71bc-4ca6-86f0-e478c09f9987]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:19 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900" returned: 0 in 0.505s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb26e7f-00ec-4885-a7da-4e0d6653b3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67be4f26-b1a6-4585-87fc-77c19f15f900', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8179a1c-981a-447c-9337-46ff9e4b2f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:19 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Volume volume-67be4f26-b1a6-4585-87fc-77c19f15f900 (67be4f26-b1a6-4585-87fc-77c19f15f900): created successfully
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8179a1c-981a-447c-9337-46ff9e4b2f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Flow 'volume_create_manager' (99cd57fa-f5ed-454d-873d-737846f80fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-305f9faf-37de-45e3-a45f-c750a03c33c0 tempest-VolumesMetadataTest-588240735 None] Created volume successfully.
Feb 27 01:28:19 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f
Feb 27 01:28:19 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:19 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0fa10-f204-43d9-a13c-c1569270687e" returned: 0 in 0.501s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-e2a0fa10-f204-43d9-a13c-c1569270687e" released by "delete_volume" :: held 1.147s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Created reservations ['b9700bbe-c737-4704-9e85-58743255a7da', 'c2905af4-4565-4b35-a32b-f47a6a8b2b3b', 'f98cd807-95a2-43bb-89e0-dc830997918d', '766d05ff-c949-45be-9492-67eb59fca2a2'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:19 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:19 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:19 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f" returned: 0 in 0.644s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:19 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f
Feb 27 01:28:19 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:20 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.490s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Deleted volume successfully.
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9dfff469-6f3c-40e6-8b96-0d379c5cb696 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-e2a0fa10-f204-43d9-a13c-c1569270687e-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:20 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-777070b4-356b-4626-a515-df6a21702d5f" returned: 0 in 0.439s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-777070b4-356b-4626-a515-df6a21702d5f" released by "delete_volume" :: held 1.107s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Created reservations ['93f8dc29-c5a8-42ef-a41c-7ab1e3df65ea', 'c443f7b2-eeab-43ea-ab80-1a6577e75a2a', 'ef5f7960-771a-44ab-b392-f73122aff98d', '619e279a-763f-4ed0-bbeb-b465ea705994'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Acquiring lock "cinder-67be4f26-b1a6-4585-87fc-77c19f15f900-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Lock "cinder-67be4f26-b1a6-4585-87fc-77c19f15f900-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:20 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:20 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Acquiring lock "cinder-quobyte-67be4f26-b1a6-4585-87fc-77c19f15f900" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Lock "cinder-quobyte-67be4f26-b1a6-4585-87fc-77c19f15f900" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb3e739-92b6-4e23-8309-1e066bc42f18]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-838868f5-b447-4e0b-9694-de0da6c0a17b-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-838868f5-b447-4e0b-9694-de0da6c0a17b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-838868f5-b447-4e0b-9694-de0da6c0a17b" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-838868f5-b447-4e0b-9694-de0da6c0a17b" acquired by "delete_volume" :: waited 0.006s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:20 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900
Feb 27 01:28:20 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a787143d-db20-49f1-aeba-98e5c32d40ce]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:20 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b
Feb 27 01:28:20 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:20 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.551s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:28:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-40588ffa-aab7-40fe-9998-0ee1fbceb230 tempest-VolumesGetTest-1221146508 None] Lock "cinder-777070b4-356b-4626-a515-df6a21702d5f-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:21 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900" returned: 0 in 0.535s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900
Feb 27 01:28:21 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:21 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b" returned: 0 in 0.521s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b
Feb 27 01:28:21 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-54f38551-25f2-42ae-a30c-9a8fb0437a2a-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Lock "cinder-54f38551-25f2-42ae-a30c-9a8fb0437a2a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Acquiring lock "cinder-quobyte-54f38551-25f2-42ae-a30c-9a8fb0437a2a" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-54f38551-25f2-42ae-a30c-9a8fb0437a2a" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[789aca05-3701-41a1-aae8-49e3dce21aee]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67be4f26-b1a6-4585-87fc-77c19f15f900" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Lock "cinder-quobyte-67be4f26-b1a6-4585-87fc-77c19f15f900" released by "delete_volume" :: held 1.072s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:21 devstack sudo[89270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:21 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:21 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-838868f5-b447-4e0b-9694-de0da6c0a17b" returned: 0 in 0.509s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-838868f5-b447-4e0b-9694-de0da6c0a17b" released by "delete_volume" :: held 1.056s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Created reservations ['550009ae-05b0-4c77-9049-25763fbd01cd', '9919da10-da82-428c-a930-1630909f4f1c', '515e0a4e-f0e5-4fe3-b01f-6b53573d6eb1', '292f9c33-6ff5-4ace-80a2-9692a8314f67'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Created reservations ['5ed811e6-759b-4cc7-94f8-e1488b0437c2', '20f852fb-58a0-4155-92ad-af328c70c1f6', '80f98f06-6029-41e3-a6f0-22f4af05cfde', '346aea2e-c99d-4f5e-a11d-380594811085'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:21 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:21 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:22 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 0 in 0.634s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:22 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:22 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:22 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.484s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Deleted volume successfully.
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-10b67ae3-a74d-44c6-9f85-99599eed83ac tempest-VolumesMetadataTest-588240735 None] Lock "cinder-67be4f26-b1a6-4585-87fc-77c19f15f900-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:22 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.513s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Deleted volume successfully.
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-89b3a8c4-d345-4fd1-a01c-a4ebecaa7dca tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-838868f5-b447-4e0b-9694-de0da6c0a17b-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:22 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 1 in 0.587s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:22 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a
Feb 27 01:28:22 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-64117825-9b73-4bc8-b29b-d4f4cfece675-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-64117825-9b73-4bc8-b29b-d4f4cfece675-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "cinder-quobyte-64117825-9b73-4bc8-b29b-d4f4cfece675" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-64117825-9b73-4bc8-b29b-d4f4cfece675" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c63e4-2a59-4e8f-babd-fd0cd7cb244f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:22 devstack sudo[89288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675
Feb 27 01:28:22 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:23 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-54f38551-25f2-42ae-a30c-9a8fb0437a2a" returned: 0 in 0.773s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Lock "cinder-quobyte-54f38551-25f2-42ae-a30c-9a8fb0437a2a" released by "delete_volume" :: held 2.041s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Created reservations ['f7d23b6b-6d51-425f-9c2a-15047642383b', '8b34f495-f8c5-45bf-85a8-c8ea9344215d', 'cefcafea-e6c6-437d-88aa-192f567ca83a', '816dd1f8-890a-44a6-b4c0-970fcf5e1f52'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:23 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675" returned: 0 in 0.802s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:23 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:23 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:23 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:23 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:24 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.514s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Deleted volume successfully.
Feb 27 01:28:24 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-64117825-9b73-4bc8-b29b-d4f4cfece675" returned: 0 in 0.566s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-quobyte-64117825-9b73-4bc8-b29b-d4f4cfece675" released by "delete_volume" :: held 1.397s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d3f698e7-135e-4907-9d10-14742788a5ab tempest-VolumesGetTest-1221146508 None] Lock "cinder-54f38551-25f2-42ae-a30c-9a8fb0437a2a-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Created reservations ['1482de79-0cb1-419b-845c-472ea9d9bd74', 'fbdfff49-f9f1-4754-87f8-1cc3df595947', 'f57e4183-0449-4bf3-b2a9-000fbc5a019d', '3a4bfbfe-537d-4761-ae23-73d906457d68'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:24 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:24 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:24 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.631s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Deleted volume successfully.
Feb 27 01:28:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-694121f4-a863-41ef-905f-ab36a5540fc8 tempest-VolumeDependencyTests-1047019136 None] Lock "cinder-64117825-9b73-4bc8-b29b-d4f4cfece675-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:25 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-e6add9a1-f967-4d3f-bc83-9e918e74e3ca tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Terminate volume connection completed successfully.
Feb 27 01:28:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-e6add9a1-f967-4d3f-bc83-9e918e74e3ca tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Deleting attachment 01aa99b0-9874-4897-9977-a1a4dfb8f505. {{(pid=83910) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "cinder-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "cinder-quobyte-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-quobyte-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[944623a1-9a67-4a82-ad89-f51053a30a82]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Flow 'volume_create_manager' (149c2d84-4c96-4ad1-a5a4-9be17f01d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:26 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d
Feb 27 01:28:26 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a873dd0-0e48-4a3f-a93a-0c5e3d119bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a873dd0-0e48-4a3f-a93a-0c5e3d119bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1041643695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c77264-f77c-4ae2-90c5-c01ad20a4c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b564c9e32e4c4867abbcf73baf31cdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:27Z,use_quota=True,user_id='a87f297a24584300810e4e0956b4c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e4352c-bb78-47e2-913e-92ff60d04983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e4352c-bb78-47e2-913e-92ff60d04983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd88cd-ef27-440e-b26a-e3fdf12ea8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd88cd-ef27-440e-b26a-e3fdf12ea8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c77264-f77c-4ae2-90c5-c01ad20a4c83', 'volume_name': 'volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f93f42-29fc-464c-92dc-cb2c71798004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f93f42-29fc-464c-92dc-cb2c71798004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c38ebe-1c78-43b4-afc6-456a1a3b4627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Volume 48c77264-f77c-4ae2-90c5-c01ad20a4c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83', 'volume_size': 1}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1041643695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c77264-f77c-4ae2-90c5-c01ad20a4c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b564c9e32e4c4867abbcf73baf31cdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:27Z,use_quota=True,user_id='a87f297a24584300810e4e0956b4c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Creating volume 48c77264-f77c-4ae2-90c5-c01ad20a4c83 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:26 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:26 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 1073741824
Feb 27 01:28:26 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:27 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" returned: 0 in 0.657s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:27 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d
Feb 27 01:28:27 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:27 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 1073741824" returned: 0 in 0.600s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:27 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83
Feb 27 01:28:27 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:27 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" returned: 0 in 0.529s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-quobyte-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d" released by "delete_volume" :: held 1.268s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.quota [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Created reservations ['da580d7a-1cc6-468c-af41-ee5b147b4b62', '7fd664fd-442d-404c-82d3-ecb48c06a15d', '6704d0a1-bceb-4198-b13b-994c4cad450d', '72cb234f-7ba5-44d5-b828-bc6464dad08e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:27 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:27 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:27 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83" returned: 0 in 0.515s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c38ebe-1c78-43b4-afc6-456a1a3b4627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7edf5d-8952-4bb6-90c0-9eb896940293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:27 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Volume volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 (48c77264-f77c-4ae2-90c5-c01ad20a4c83): created successfully
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7edf5d-8952-4bb6-90c0-9eb896940293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Flow 'volume_create_manager' (149c2d84-4c96-4ad1-a5a4-9be17f01d741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:27 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e7b8936f-8ad9-49ef-9d85-0e6f3508ef33 tempest-VolumesTransfersTest-385704501 None] Created volume successfully.
Feb 27 01:28:28 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.505s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.manager [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Deleted volume successfully.
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-eeeb807f-cfaf-4654-b5ae-021ef553a84d req-d2c2b8cc-6ff5-41f6-b261-a8d10721de28 tempest-ServerBootFromVolumeStableRescueTest-1924007398 None] Lock "cinder-e2a0f06f-dba5-4fb9-ade5-e69cefddc96d-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Flow 'volume_create_manager' (7d1e78b3-f4a5-46a0-b243-e22d459d97b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cf041b-83ff-4475-b726-742c611e4b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cf041b-83ff-4475-b726-742c611e4b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1915045893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1521942-78f0-4f7e-ad6e-da5dcbba89fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2c0cbd9bad4476ab520946cd3fe31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:29Z,use_quota=True,user_id='10a3b2eac89548bba702401def085173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624102f2-bdd7-4417-90f2-3aca5a89d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624102f2-bdd7-4417-90f2-3aca5a89d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b842914f-db98-456b-a2a8-d4842b8f1ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b842914f-db98-456b-a2a8-d4842b8f1ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1521942-78f0-4f7e-ad6e-da5dcbba89fa', 'volume_name': 'volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a823805e-39d3-4094-a6da-34519f67299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a823805e-39d3-4094-a6da-34519f67299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9028d907-aca5-4a6e-887e-bcac0bb7e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:28 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Volume b1521942-78f0-4f7e-ad6e-da5dcbba89fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa', 'volume_size': 1}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1915045893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1521942-78f0-4f7e-ad6e-da5dcbba89fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2c0cbd9bad4476ab520946cd3fe31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:29Z,use_quota=True,user_id='10a3b2eac89548bba702401def085173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Creating volume b1521942-78f0-4f7e-ad6e-da5dcbba89fa {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:28 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:28 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa 1073741824
Feb 27 01:28:28 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:29 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-fc35d38c-2e22-4257-8538-8b15e6a37588 tempest-VolumesTransfersTest-234737519 None] Transfer volume completed successfully.
Feb 27 01:28:29 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa 1073741824" returned: 0 in 0.591s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:29 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa
Feb 27 01:28:29 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:30 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa" returned: 0 in 0.549s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9028d907-aca5-4a6e-887e-bcac0bb7e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c41c70-66b2-4452-b468-153bfe5fffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:30 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Volume volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa (b1521942-78f0-4f7e-ad6e-da5dcbba89fa): created successfully
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c41c70-66b2-4452-b468-153bfe5fffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Flow 'volume_create_manager' (7d1e78b3-f4a5-46a0-b243-e22d459d97b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:30 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bc3cba84-1829-44ba-91f3-7aa2793b333a tempest-VolumesNegativeTest-152874717 None] Created volume successfully.
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Acquiring lock "cinder-48c77264-f77c-4ae2-90c5-c01ad20a4c83-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-48c77264-f77c-4ae2-90c5-c01ad20a4c83-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Acquiring lock "cinder-quobyte-48c77264-f77c-4ae2-90c5-c01ad20a4c83" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-quobyte-48c77264-f77c-4ae2-90c5-c01ad20a4c83" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0754ebc7-245f-4f18-b1ac-8595ec9e0a51]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:30 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83
Feb 27 01:28:30 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:30 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:30 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:30 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83" returned: 0 in 0.620s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:30 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83
Feb 27 01:28:30 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:31 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.616s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:31 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-48c77264-f77c-4ae2-90c5-c01ad20a4c83" returned: 0 in 0.693s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-quobyte-48c77264-f77c-4ae2-90c5-c01ad20a4c83" released by "delete_volume" :: held 1.349s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Created reservations ['70f8889b-4312-4358-bf03-89a0c9759dff', '4dcb5d2d-de52-4721-9e19-8dbbe999715a', '3ed59adf-0d09-4a7d-ac75-42f893795d64', 'a9c25cfb-2e3c-4cbb-ae47-f8eac9785c8c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:31 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:31 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:32 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.513s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:32 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Deleted volume successfully.
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-7acb3f40-9571-46da-be1a-7f3bd7216c37 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-48c77264-f77c-4ae2-90c5-c01ad20a4c83-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Flow 'volume_create_manager' (6a8575d1-b10d-4b05-9ae5-890d1943d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128ed534-6feb-45de-a74f-702f921ddfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128ed534-6feb-45de-a74f-702f921ddfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1346777638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffdfaee-29ab-4af1-a169-f6c5010c521a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b564c9e32e4c4867abbcf73baf31cdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:33Z,use_quota=True,user_id='a87f297a24584300810e4e0956b4c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd355db3-4389-4866-b19c-5ef8e007bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd355db3-4389-4866-b19c-5ef8e007bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d313fd71-5fc8-463f-87b1-f1e7d92a4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d313fd71-5fc8-463f-87b1-f1e7d92a4477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffdfaee-29ab-4af1-a169-f6c5010c521a', 'volume_name': 'volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f84a8ab-69c3-4e9c-9ff5-493500515b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f84a8ab-69c3-4e9c-9ff5-493500515b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63e7bea-0020-4426-bdab-a1cb93945407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:32 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Volume 6ffdfaee-29ab-4af1-a169-f6c5010c521a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a', 'volume_size': 1}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1346777638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffdfaee-29ab-4af1-a169-f6c5010c521a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b564c9e32e4c4867abbcf73baf31cdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:33Z,use_quota=True,user_id='a87f297a24584300810e4e0956b4c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Creating volume 6ffdfaee-29ab-4af1-a169-f6c5010c521a {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:32 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:32 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a 1073741824
Feb 27 01:28:32 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:33 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a 1073741824" returned: 0 in 0.551s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:33 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a
Feb 27 01:28:33 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:33 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63e7bea-0020-4426-bdab-a1cb93945407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e19c1ee-1516-47eb-833c-eeeca5e72b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:33 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Volume volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a (6ffdfaee-29ab-4af1-a169-f6c5010c521a): created successfully
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e19c1ee-1516-47eb-833c-eeeca5e72b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Flow 'volume_create_manager' (6a8575d1-b10d-4b05-9ae5-890d1943d579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:33 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-0a72a524-6f9d-4104-81c3-02afc2c20ee8 tempest-VolumesTransfersTest-385704501 None] Created volume successfully.
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Acquiring lock "cinder-6ffdfaee-29ab-4af1-a169-f6c5010c521a-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-6ffdfaee-29ab-4af1-a169-f6c5010c521a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=142,cinder:INSERT=42,cinder:UPDATE=207,cinder:DELETE=16 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=149,cinder:INSERT=63,cinder:UPDATE=177,cinder:DELETE=16 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Acquiring lock "cinder-quobyte-6ffdfaee-29ab-4af1-a169-f6c5010c521a" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-quobyte-6ffdfaee-29ab-4af1-a169-f6c5010c521a" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e4050-180c-400d-877f-01bffa94267c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:35 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a
Feb 27 01:28:35 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:35 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a" returned: 0 in 0.520s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:35 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a
Feb 27 01:28:35 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:36 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-6ffdfaee-29ab-4af1-a169-f6c5010c521a" returned: 0 in 0.464s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-quobyte-6ffdfaee-29ab-4af1-a169-f6c5010c521a" released by "delete_volume" :: held 1.015s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Created reservations ['3971bb80-c920-4653-854e-69e7a8025486', 'd911a938-7e1f-4a24-b913-b3d35cbe6f23', '97703f10-78bc-4a32-a3e1-57142dcd7642', '5519b258-cb9e-4ff8-849d-622b47f823d4'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:36 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:28:36 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:36 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.444s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:36 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Deleted volume successfully.
Feb 27 01:28:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d849ca16-b7bf-4d15-b012-adfe9b57eeb2 tempest-VolumesTransfersTest-2121937350 None] Lock "cinder-6ffdfaee-29ab-4af1-a169-f6c5010c521a-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:46 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:28:50 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=13 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:28:54 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Flow 'volume_create_manager' (b06c0b40-ea56-4edf-b693-cac65402c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc493205-6b48-494d-9e36-622777d078ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc493205-6b48-494d-9e36-622777d078ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512126233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e358e1-33ad-4516-92c3-54dd7102f42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b253fe951549a389e57e6374a2c66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:55Z,use_quota=True,user_id='55e39cc40a1f4aa990a8fdb704c56a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc6f608-ee0f-4fe5-8171-36c37c79dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc6f608-ee0f-4fe5-8171-36c37c79dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac64cf-1318-45b9-9b99-73a74c4a1093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac64cf-1318-45b9-9b99-73a74c4a1093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e358e1-33ad-4516-92c3-54dd7102f42f', 'volume_name': 'volume-79e358e1-33ad-4516-92c3-54dd7102f42f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea6341a-2200-4aff-bb36-82b22c3849b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea6341a-2200-4aff-bb36-82b22c3849b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7358c104-1b84-4136-ad09-24fd03a4b0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Volume 79e358e1-33ad-4516-92c3-54dd7102f42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e358e1-33ad-4516-92c3-54dd7102f42f', 'volume_size': 1}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512126233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e358e1-33ad-4516-92c3-54dd7102f42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b253fe951549a389e57e6374a2c66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:55Z,use_quota=True,user_id='55e39cc40a1f4aa990a8fdb704c56a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Creating volume 79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:55 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:55 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f 1073741824
Feb 27 01:28:55 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:55 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f 1073741824" returned: 0 in 0.611s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:55 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:28:55 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:56 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.478s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7358c104-1b84-4136-ad09-24fd03a4b0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e358e1-33ad-4516-92c3-54dd7102f42f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48be034a-4aa0-49d9-a549-912d746afae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Volume volume-79e358e1-33ad-4516-92c3-54dd7102f42f (79e358e1-33ad-4516-92c3-54dd7102f42f): created successfully
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48be034a-4aa0-49d9-a549-912d746afae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Flow 'volume_create_manager' (b06c0b40-ea56-4edf-b693-cac65402c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b9cb9ac7-35ab-43cc-99be-ddb165c8d705 tempest-VolumesActionsTest-1931057584 None] Created volume successfully.
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Acquiring lock "cinder-b1521942-78f0-4f7e-ad6e-da5dcbba89fa-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Lock "cinder-b1521942-78f0-4f7e-ad6e-da5dcbba89fa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Acquiring lock "cinder-quobyte-b1521942-78f0-4f7e-ad6e-da5dcbba89fa" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Lock "cinder-quobyte-b1521942-78f0-4f7e-ad6e-da5dcbba89fa" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[82999720-a803-4dd4-9620-11469335ae46]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:01 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa
Feb 27 01:29:01 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:01 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa" returned: 0 in 0.643s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:01 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa
Feb 27 01:29:01 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:02 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b1521942-78f0-4f7e-ad6e-da5dcbba89fa" returned: 0 in 0.413s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Lock "cinder-quobyte-b1521942-78f0-4f7e-ad6e-da5dcbba89fa" released by "delete_volume" :: held 1.078s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Created reservations ['4f258586-65eb-4e15-b222-5408a8e67865', 'bd2fde39-22af-4cf0-86e8-7ef7c818a17e', 'd7ab29ec-65f8-4bbd-b486-e09eefe749ff', 'fb89801c-c3b0-496e-b049-8d63d36268ca'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:02 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:02 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:02 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.429s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:02 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Deleted volume successfully.
Feb 27 01:29:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cd040de0-9663-47b8-9702-74be400f9e5c tempest-VolumesNegativeTest-152874717 None] Lock "cinder-b1521942-78f0-4f7e-ad6e-da5dcbba89fa-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (f4a31bac-9914-4927-9cab-5b946b44405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b28ea7-1305-4170-9a11-d76b3f85b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b28ea7-1305-4170-9a11-d76b3f85b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936291821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed84d393-3c0f-46af-933e-611255ded8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:05Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b09b92d-d5fc-415f-b047-60e91f1b64f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b09b92d-d5fc-415f-b047-60e91f1b64f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9798ef6b-a19a-41c4-ac10-e8727c231b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9798ef6b-a19a-41c4-ac10-e8727c231b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed84d393-3c0f-46af-933e-611255ded8d2', 'volume_name': 'volume-ed84d393-3c0f-46af-933e-611255ded8d2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf16060-960f-4ee4-9a46-75c9f3fa97f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf16060-960f-4ee4-9a46-75c9f3fa97f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110de968-d361-4951-bf06-f286ac863890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Volume ed84d393-3c0f-46af-933e-611255ded8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed84d393-3c0f-46af-933e-611255ded8d2', 'volume_size': 1}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936291821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed84d393-3c0f-46af-933e-611255ded8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:05Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Creating volume ed84d393-3c0f-46af-933e-611255ded8d2 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:05 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:05 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2 1073741824
Feb 27 01:29:05 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (5e758a81-89f2-45c7-b845-ec52104083ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fc67af-2f20-4c58-b44b-a2b4713cc244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fc67af-2f20-4c58-b44b-a2b4713cc244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-820409294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc26bc53-aab9-4ea8-a2e6-96487a8acc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:05Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ab5306-d503-44c8-9619-e020a4b04a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ab5306-d503-44c8-9619-e020a4b04a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90d962d-ff5e-4607-b331-9710ef227742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90d962d-ff5e-4607-b331-9710ef227742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc26bc53-aab9-4ea8-a2e6-96487a8acc83', 'volume_name': 'volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203f8cf9-c3e1-4c13-a194-f038750ac79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203f8cf9-c3e1-4c13-a194-f038750ac79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e0ba4-5fff-4c5a-84f4-706ab6b187f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Volume fc26bc53-aab9-4ea8-a2e6-96487a8acc83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83', 'volume_size': 1}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (11e318e0-dfbc-433f-b06d-bc43bf9b6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3691ff-0182-416e-9d1b-de0cf9c0e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3691ff-0182-416e-9d1b-de0cf9c0e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146047042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91333c24-8f86-44f0-a3ad-0228a47535a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:06Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572f5c3f-f4ab-48b0-9877-2048000d6dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572f5c3f-f4ab-48b0-9877-2048000d6dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c75d37-62c3-41b0-b298-05c618b3f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c75d37-62c3-41b0-b298-05c618b3f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91333c24-8f86-44f0-a3ad-0228a47535a2', 'volume_name': 'volume-91333c24-8f86-44f0-a3ad-0228a47535a2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253fdf81-ad1e-4f93-8f9e-b473391d24a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253fdf81-ad1e-4f93-8f9e-b473391d24a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba4be7-5853-4477-be55-53d615ee3f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Volume 91333c24-8f86-44f0-a3ad-0228a47535a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91333c24-8f86-44f0-a3ad-0228a47535a2', 'volume_size': 1}
Feb 27 01:29:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (c170f79f-89ee-4c91-9766-11f6350d30ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb185d8b-520a-447d-8449-941d5efadfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2 1073741824" returned: 0 in 0.694s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb185d8b-520a-447d-8449-941d5efadfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2120352610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4175eb9f-3c58-43b9-82bc-317077dbf202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:06Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db5168-1f01-46cf-9b78-3a45f6fcf6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db5168-1f01-46cf-9b78-3a45f6fcf6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53c9c88-e70c-4f59-a1b2-86806774d013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53c9c88-e70c-4f59-a1b2-86806774d013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4175eb9f-3c58-43b9-82bc-317077dbf202', 'volume_name': 'volume-4175eb9f-3c58-43b9-82bc-317077dbf202', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26bf54c-7c98-4e8c-918e-452d8d3dc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26bf54c-7c98-4e8c-918e-452d8d3dc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fee1025-01a0-4b19-be98-14259dc8819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Volume 4175eb9f-3c58-43b9-82bc-317077dbf202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4175eb9f-3c58-43b9-82bc-317077dbf202', 'volume_size': 1}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:06 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2
Feb 27 01:29:06 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (eee8a880-c4d5-411d-9803-7655b2906981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5607f5a7-cd4b-44ad-93f0-97610538ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5607f5a7-cd4b-44ad-93f0-97610538ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023491763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a0aa5-c5b9-4f61-8f00-aa0784f15d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:06Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed61e8b-df59-4220-a80f-39cc6647695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed61e8b-df59-4220-a80f-39cc6647695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aa1b8d-228f-42b5-a4f8-11835590aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aa1b8d-228f-42b5-a4f8-11835590aff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57a0aa5-c5b9-4f61-8f00-aa0784f15d47', 'volume_name': 'volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7632cde-23a3-4850-a698-6f58226d61e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7632cde-23a3-4850-a698-6f58226d61e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98150190-cc33-4001-8843-3b05a67360cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Volume c57a0aa5-c5b9-4f61-8f00-aa0784f15d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47', 'volume_size': 1}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:06 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2" returned: 0 in 0.457s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-820409294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc26bc53-aab9-4ea8-a2e6-96487a8acc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:05Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Creating volume fc26bc53-aab9-4ea8-a2e6-96487a8acc83 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:06 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:06 devstack sudo[89642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 1073741824
Feb 27 01:29:06 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110de968-d361-4951-bf06-f286ac863890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed84d393-3c0f-46af-933e-611255ded8d2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675a2263-863f-4785-abe7-1921ea240992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Volume volume-ed84d393-3c0f-46af-933e-611255ded8d2 (ed84d393-3c0f-46af-933e-611255ded8d2): created successfully
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675a2263-863f-4785-abe7-1921ea240992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (f4a31bac-9914-4927-9cab-5b946b44405e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:06 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c7c228d4-33a9-490b-97e6-cf2341ff38ae tempest-CreateVolumesFromImageTest-81099014 None] Created volume successfully.
Feb 27 01:29:07 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 1073741824" returned: 0 in 0.547s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:07 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83
Feb 27 01:29:07 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:07 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83" returned: 0 in 0.494s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146047042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91333c24-8f86-44f0-a3ad-0228a47535a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:06Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Creating volume 91333c24-8f86-44f0-a3ad-0228a47535a2 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:07 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e0ba4-5fff-4c5a-84f4-706ab6b187f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:07 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2 1073741824
Feb 27 01:29:07 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d100bc6b-3aef-4913-a1ad-b285fa056529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:07 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Volume volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 (fc26bc53-aab9-4ea8-a2e6-96487a8acc83): created successfully
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d100bc6b-3aef-4913-a1ad-b285fa056529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (5e758a81-89f2-45c7-b845-ec52104083ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-7e5ec2ce-0312-4d30-a656-0d78ad030c6a tempest-CreateVolumesFromImageTest-81099014 None] Created volume successfully.
Feb 27 01:29:08 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2 1073741824" returned: 0 in 0.539s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:08 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2
Feb 27 01:29:08 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:08 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2" returned: 0 in 0.387s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2120352610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4175eb9f-3c58-43b9-82bc-317077dbf202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:06Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Creating volume 4175eb9f-3c58-43b9-82bc-317077dbf202 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:08 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba4be7-5853-4477-be55-53d615ee3f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91333c24-8f86-44f0-a3ad-0228a47535a2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:08 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202 1073741824
Feb 27 01:29:08 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29ec7d5-8a6a-49ae-a6bd-4a9792a9342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Volume volume-91333c24-8f86-44f0-a3ad-0228a47535a2 (91333c24-8f86-44f0-a3ad-0228a47535a2): created successfully
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29ec7d5-8a6a-49ae-a6bd-4a9792a9342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (11e318e0-dfbc-433f-b06d-bc43bf9b6c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-04c8d30f-b359-42b3-a960-d77c758a2740 tempest-CreateVolumesFromImageTest-81099014 None] Created volume successfully.
Feb 27 01:29:09 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202 1073741824" returned: 0 in 0.753s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:09 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202
Feb 27 01:29:09 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:10 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202" returned: 0 in 0.560s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.672s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023491763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a0aa5-c5b9-4f61-8f00-aa0784f15d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566623fb13b0458ab39b1f7894c56bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:06Z,use_quota=True,user_id='7b5e6321f62a446a993eade6160b0152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Creating volume c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:10 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fee1025-01a0-4b19-be98-14259dc8819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4175eb9f-3c58-43b9-82bc-317077dbf202', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2f3a03-9678-4e17-b643-a0e653c3a67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:10 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 1073741824
Feb 27 01:29:10 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:10 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Volume volume-4175eb9f-3c58-43b9-82bc-317077dbf202 (4175eb9f-3c58-43b9-82bc-317077dbf202): created successfully
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2f3a03-9678-4e17-b643-a0e653c3a67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (c170f79f-89ee-4c91-9766-11f6350d30ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:10 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9a130989-bae4-4126-9dc3-f2b2b6311cce tempest-CreateVolumesFromImageTest-81099014 None] Created volume successfully.
Feb 27 01:29:10 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 1073741824" returned: 0 in 0.687s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:10 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47
Feb 27 01:29:10 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:11 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98150190-cc33-4001-8843-3b05a67360cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de0e56c-9483-401d-8c74-38b04a96fb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Volume volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 (c57a0aa5-c5b9-4f61-8f00-aa0784f15d47): created successfully
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de0e56c-9483-401d-8c74-38b04a96fb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Flow 'volume_create_manager' (eee8a880-c4d5-411d-9803-7655b2906981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d16f4acc-ff99-4324-8ea0-19eeca7ab737 tempest-CreateVolumesFromImageTest-81099014 None] Created volume successfully.
Feb 27 01:29:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-quobyte-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47" acquired by "delete_volume" :: waited 0.032s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560e533-42d6-42ed-b092-58097a9587e4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:12 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47
Feb 27 01:29:12 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:13 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47" returned: 0 in 0.713s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:13 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47
Feb 27 01:29:13 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:13 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47" returned: 0 in 0.520s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47" released by "delete_volume" :: held 1.325s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Created reservations ['704fad2c-8c91-4b61-b819-33f05e6c254a', 'bb030abc-db1a-4ab2-b265-5d8f3fd0e879', '2c0e5231-92e2-4dd5-9b94-84520b0069e0', 'dc94153e-1583-48ef-887b-ad4b7609cc8a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98f16355-ec57-4eb2-b91a-b052dd431628 tempest-VolumesActionsTest-1931057584 None] Acquiring lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f" by "attach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:13 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:13 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98f16355-ec57-4eb2-b91a-b052dd431628 tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f" acquired by "attach_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-98f16355-ec57-4eb2-b91a-b052dd431628 tempest-VolumesActionsTest-1931057584 None] Attaching volume 79e358e1-33ad-4516-92c3-54dd7102f42f to instance 922c6b67-7fbb-4ade-a36c-d1aa4d2b6b6a at mountpoint /dev/vdb on host None.
Feb 27 01:29:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-98f16355-ec57-4eb2-b91a-b052dd431628 tempest-VolumesActionsTest-1931057584 None] Attach volume completed successfully.
Feb 27 01:29:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98f16355-ec57-4eb2-b91a-b052dd431628 tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f" released by "attach_volume" :: held 0.090s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:14 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.500s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Deleted volume successfully.
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6a031fab-8525-4f49-a104-baaff02f4790 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-c57a0aa5-c5b9-4f61-8f00-aa0784f15d47-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-62c86675-186a-426c-970a-1b9be0b6985e tempest-VolumesActionsTest-1931057584 None] Acquiring lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-detach_volume" by "detach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-62c86675-186a-426c-970a-1b9be0b6985e tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-62c86675-186a-426c-970a-1b9be0b6985e tempest-VolumesActionsTest-1931057584 None] Detaching volume 79e358e1-33ad-4516-92c3-54dd7102f42f from instance 922c6b67-7fbb-4ade-a36c-d1aa4d2b6b6a.
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-4175eb9f-3c58-43b9-82bc-317077dbf202-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-4175eb9f-3c58-43b9-82bc-317077dbf202-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-quobyte-4175eb9f-3c58-43b9-82bc-317077dbf202" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-62c86675-186a-426c-970a-1b9be0b6985e tempest-VolumesActionsTest-1931057584 None] Detach volume completed successfully.
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-62c86675-186a-426c-970a-1b9be0b6985e tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-4175eb9f-3c58-43b9-82bc-317077dbf202" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a90bd87-3926-4dd8-8985-9767b4cad334]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:14 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202
Feb 27 01:29:14 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:15 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202" returned: 0 in 0.693s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:15 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202
Feb 27 01:29:15 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:15 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4175eb9f-3c58-43b9-82bc-317077dbf202" returned: 0 in 0.462s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-4175eb9f-3c58-43b9-82bc-317077dbf202" released by "delete_volume" :: held 1.220s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Created reservations ['9c10343a-1df5-46c3-97e1-3efed3bcea71', '15a270df-8b6d-413d-b332-4a017b041ac5', '3a30ca80-597f-44f5-b2f4-4f5942d0c8e9', '806e3a42-3443-4e82-9f74-660a7c12713f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:15 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:15 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:16 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.472s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:16 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Deleted volume successfully.
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8f17de93-59bd-497c-b23d-aedada93d997 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-4175eb9f-3c58-43b9-82bc-317077dbf202-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-91333c24-8f86-44f0-a3ad-0228a47535a2-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-91333c24-8f86-44f0-a3ad-0228a47535a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-quobyte-91333c24-8f86-44f0-a3ad-0228a47535a2" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-91333c24-8f86-44f0-a3ad-0228a47535a2" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[45141126-ef4c-4a70-aa67-5968e68d40d6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:16 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2
Feb 27 01:29:16 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:17 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2" returned: 0 in 0.630s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:17 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2
Feb 27 01:29:17 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:17 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-91333c24-8f86-44f0-a3ad-0228a47535a2" returned: 0 in 0.613s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-91333c24-8f86-44f0-a3ad-0228a47535a2" released by "delete_volume" :: held 1.300s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:17 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Created reservations ['5f650512-beac-49f5-8653-2e8619b23d2c', '505c9bf7-8909-4ddb-9518-85dca2c0b081', '2548c69d-a57b-41fe-8db3-5ac1aeb851e0', '2c14b0f0-2d46-410a-9fb8-b4ee5a43ba8e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:18 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:18 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:18 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:18 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Deleted volume successfully.
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1410ccd1-52e6-43de-a4a4-bf2e382da108 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-91333c24-8f86-44f0-a3ad-0228a47535a2-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-fc26bc53-aab9-4ea8-a2e6-96487a8acc83-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-fc26bc53-aab9-4ea8-a2e6-96487a8acc83-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-quobyte-fc26bc53-aab9-4ea8-a2e6-96487a8acc83" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-fc26bc53-aab9-4ea8-a2e6-96487a8acc83" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057e0d0-4135-46bc-8277-b738dab0d4f0]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:18 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83
Feb 27 01:29:18 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:19 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83" returned: 0 in 0.480s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:19 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83
Feb 27 01:29:19 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:19 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-fc26bc53-aab9-4ea8-a2e6-96487a8acc83" returned: 0 in 0.428s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-fc26bc53-aab9-4ea8-a2e6-96487a8acc83" released by "delete_volume" :: held 0.930s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Created reservations ['a2670915-9999-47af-a31e-0ce705a2a303', '63fea8ec-ebec-4276-a57d-3d8fcc7f0cf4', 'd2a601cd-c858-474d-a868-05c880bb2d9e', '93f03b17-92aa-484e-8d06-8f6710feb05c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:19 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:19 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-ed84d393-3c0f-46af-933e-611255ded8d2-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-ed84d393-3c0f-46af-933e-611255ded8d2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "cinder-quobyte-ed84d393-3c0f-46af-933e-611255ded8d2" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-ed84d393-3c0f-46af-933e-611255ded8d2" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2bfd88-84b3-4693-bd5a-da3a166e14a1]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:20 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2
Feb 27 01:29:20 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:20 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.629s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Deleted volume successfully.
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-bdf9284f-96b4-4f76-a565-2eef40834a11 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-fc26bc53-aab9-4ea8-a2e6-96487a8acc83-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:20 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2" returned: 0 in 0.586s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:20 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2
Feb 27 01:29:20 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:21 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ed84d393-3c0f-46af-933e-611255ded8d2" returned: 0 in 0.425s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-quobyte-ed84d393-3c0f-46af-933e-611255ded8d2" released by "delete_volume" :: held 1.046s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Created reservations ['c8636ef1-44c4-4c02-b175-6f8f0cf1a6e3', 'd6adafc4-b964-4267-a724-bc0cc5ec61a7', '716cab9c-fe56-48ed-863e-9a348af7143c', '50ca06a3-b0db-4293-aa2c-5a784dfa5caa'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:21 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:21 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:21 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.450s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:21 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Deleted volume successfully.
Feb 27 01:29:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-95aea6c5-7a10-4eeb-a9aa-d3db4710aee1 tempest-CreateVolumesFromImageTest-81099014 None] Lock "cinder-ed84d393-3c0f-46af-933e-611255ded8d2-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:30 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:30 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=46,cinder:UPDATE=72,cinder:INSERT=15,cinder:DELETE=5 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:29:31 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.677s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=51,cinder:UPDATE=66,cinder:INSERT=17,cinder:DELETE=7 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Flow 'volume_create_manager' (50b3be2d-a99d-4fad-a736-b35411733839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e54c0f-983a-47a8-aa5b-2d3999c7872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e54c0f-983a-47a8-aa5b-2d3999c7872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-136168745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81445556-c84d-4702-89eb-725f6f35df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b430a01da47aaa066e7b48c47bfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:34Z,use_quota=True,user_id='b3293caa73c847ef9ce96b4308451a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cf92ff-6916-475f-a17b-b1e128524f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cf92ff-6916-475f-a17b-b1e128524f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac42baca-1382-428b-a64e-c0e39819992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac42baca-1382-428b-a64e-c0e39819992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81445556-c84d-4702-89eb-725f6f35df66', 'volume_name': 'volume-81445556-c84d-4702-89eb-725f6f35df66', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f40bd4-fe78-412e-ab4c-856d5441cb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f40bd4-fe78-412e-ab4c-856d5441cb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33a81a0-8c69-48e4-9bc7-3dd4da5723a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Volume 81445556-c84d-4702-89eb-725f6f35df66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81445556-c84d-4702-89eb-725f6f35df66', 'volume_size': 1}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-136168745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81445556-c84d-4702-89eb-725f6f35df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b430a01da47aaa066e7b48c47bfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:34Z,use_quota=True,user_id='b3293caa73c847ef9ce96b4308451a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Creating volume 81445556-c84d-4702-89eb-725f6f35df66 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:33 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:33 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66 1073741824
Feb 27 01:29:33 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:34 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66 1073741824" returned: 0 in 0.854s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:34 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66
Feb 27 01:29:34 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:35 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66" returned: 0 in 1.185s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33a81a0-8c69-48e4-9bc7-3dd4da5723a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81445556-c84d-4702-89eb-725f6f35df66', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b732e726-9da9-42d9-8c6c-6c3c22e6ad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:35 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Volume volume-81445556-c84d-4702-89eb-725f6f35df66 (81445556-c84d-4702-89eb-725f6f35df66): created successfully
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b732e726-9da9-42d9-8c6c-6c3c22e6ad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Flow 'volume_create_manager' (50b3be2d-a99d-4fad-a736-b35411733839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:35 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-00406a2a-9ccd-46bd-ad9a-916948b9e17b tempest-ServersNegativeTestJSON-1520703469 None] Created volume successfully.
Feb 27 01:29:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e4541bc7-f168-4489-82fc-6a61e77f21bf tempest-VolumesActionsTest-1931057584 None] Acquiring lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f" by "attach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e4541bc7-f168-4489-82fc-6a61e77f21bf tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f" acquired by "attach_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:36 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e4541bc7-f168-4489-82fc-6a61e77f21bf tempest-VolumesActionsTest-1931057584 None] Attaching volume 79e358e1-33ad-4516-92c3-54dd7102f42f to instance 467cb5da-06af-47d5-a30e-cbb4b1ba34e0 at mountpoint /dev/vdb on host None.
Feb 27 01:29:36 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e4541bc7-f168-4489-82fc-6a61e77f21bf tempest-VolumesActionsTest-1931057584 None] Attach volume completed successfully.
Feb 27 01:29:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e4541bc7-f168-4489-82fc-6a61e77f21bf tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f" released by "attach_volume" :: held 0.072s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1edb24ff-afe6-4244-ab50-e4070d69cc39 tempest-VolumesActionsTest-1931057584 None] Acquiring lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-detach_volume" by "detach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1edb24ff-afe6-4244-ab50-e4070d69cc39 tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:37 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1edb24ff-afe6-4244-ab50-e4070d69cc39 tempest-VolumesActionsTest-1931057584 None] Detaching volume 79e358e1-33ad-4516-92c3-54dd7102f42f from instance 467cb5da-06af-47d5-a30e-cbb4b1ba34e0.
Feb 27 01:29:37 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1edb24ff-afe6-4244-ab50-e4070d69cc39 tempest-VolumesActionsTest-1931057584 None] Detach volume completed successfully.
Feb 27 01:29:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1edb24ff-afe6-4244-ab50-e4070d69cc39 tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Flow 'volume_create_manager' (afad3a06-9845-4bd7-8aef-37cdaa1dae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5798654-56bf-44af-bc9c-e41c0635ef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5798654-56bf-44af-bc9c-e41c0635ef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1322409012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c319c59-e374-4e93-9e98-be7a86b2790f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b430a01da47aaa066e7b48c47bfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:39Z,use_quota=True,user_id='b3293caa73c847ef9ce96b4308451a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a1f43f-db66-442d-949d-1d9f2b95bec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a1f43f-db66-442d-949d-1d9f2b95bec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ec945f-6279-4b28-9b1f-e6f4970511b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ec945f-6279-4b28-9b1f-e6f4970511b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c319c59-e374-4e93-9e98-be7a86b2790f', 'volume_name': 'volume-9c319c59-e374-4e93-9e98-be7a86b2790f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881d2100-d8ae-4ca7-a394-912d77f717a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881d2100-d8ae-4ca7-a394-912d77f717a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49196934-a738-474e-b7b2-b177bdc94958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:38 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Volume 9c319c59-e374-4e93-9e98-be7a86b2790f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c319c59-e374-4e93-9e98-be7a86b2790f', 'volume_size': 1}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1322409012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c319c59-e374-4e93-9e98-be7a86b2790f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b430a01da47aaa066e7b48c47bfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:39Z,use_quota=True,user_id='b3293caa73c847ef9ce96b4308451a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Creating volume 9c319c59-e374-4e93-9e98-be7a86b2790f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:38 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:38 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f 1073741824
Feb 27 01:29:38 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:39 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f 1073741824" returned: 0 in 0.806s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:39 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f
Feb 27 01:29:39 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:40 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f" returned: 0 in 0.850s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49196934-a738-474e-b7b2-b177bdc94958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c319c59-e374-4e93-9e98-be7a86b2790f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741f2e87-8b59-4b27-936b-464ea82de08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Volume volume-9c319c59-e374-4e93-9e98-be7a86b2790f (9c319c59-e374-4e93-9e98-be7a86b2790f): created successfully
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741f2e87-8b59-4b27-936b-464ea82de08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Flow 'volume_create_manager' (afad3a06-9845-4bd7-8aef-37cdaa1dae6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c2cd7e32-712f-4d05-a130-8cf1e4c7a247 tempest-ServersNegativeTestJSON-1520703469 None] Created volume successfully.
Feb 27 01:29:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "cinder-9c319c59-e374-4e93-9e98-be7a86b2790f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-9c319c59-e374-4e93-9e98-be7a86b2790f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "cinder-quobyte-9c319c59-e374-4e93-9e98-be7a86b2790f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-quobyte-9c319c59-e374-4e93-9e98-be7a86b2790f" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:42 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ddf730-2b7a-43cf-a8ba-29c90e75c59c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:42 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f
Feb 27 01:29:42 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:43 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f" returned: 0 in 0.611s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:43 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f
Feb 27 01:29:43 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:43 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9c319c59-e374-4e93-9e98-be7a86b2790f" returned: 0 in 0.557s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-quobyte-9c319c59-e374-4e93-9e98-be7a86b2790f" released by "delete_volume" :: held 1.212s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Created reservations ['c8d08d9f-83b6-4436-9b2d-1e48294bbb21', '04e8b315-c15e-40ee-b44a-c8336dfaa837', '2f9f9f51-0f5d-4338-a57d-6675f2a93fb6', 'bef40602-ac3a-49d6-8e07-0feb3664b017'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:43 devstack sudo[89988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:43 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:44 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.534s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:44 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Deleted volume successfully.
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-98df93c7-bc24-4ce2-805d-639d3ce2b4e8 tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-9c319c59-e374-4e93-9e98-be7a86b2790f-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "cinder-81445556-c84d-4702-89eb-725f6f35df66-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-81445556-c84d-4702-89eb-725f6f35df66-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "cinder-quobyte-81445556-c84d-4702-89eb-725f6f35df66" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-quobyte-81445556-c84d-4702-89eb-725f6f35df66" acquired by "delete_volume" :: waited 0.015s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d4c309-cda3-487a-b6a0-e2c4d748a2dd]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:44 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66
Feb 27 01:29:44 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Flow 'volume_create_manager' (21ba84f5-d670-4fd7-aaea-345a188b1a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedbf8c1-4228-40c4-9a68-b7983c582200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:45 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedbf8c1-4228-40c4-9a68-b7983c582200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1002128496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09e933e-42ec-4664-8085-729145fb3be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eedb29d4c84d89a5d8ce73c9c902a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:45Z,use_quota=True,user_id='4044b979c42d40dbb6f7ffebed3df520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b5f243-7ce2-48f0-9476-22f51927e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b5f243-7ce2-48f0-9476-22f51927e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d1570e-3f74-401d-a93b-d770536ecad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d1570e-3f74-401d-a93b-d770536ecad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09e933e-42ec-4664-8085-729145fb3be2', 'volume_name': 'volume-e09e933e-42ec-4664-8085-729145fb3be2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e434560-5534-44f5-bb99-24198755fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e434560-5534-44f5-bb99-24198755fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246d0a0c-3a58-429b-a50c-a093304bf571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:45 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Volume e09e933e-42ec-4664-8085-729145fb3be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09e933e-42ec-4664-8085-729145fb3be2', 'volume_size': 1}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1002128496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09e933e-42ec-4664-8085-729145fb3be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eedb29d4c84d89a5d8ce73c9c902a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:45Z,use_quota=True,user_id='4044b979c42d40dbb6f7ffebed3df520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Creating volume e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:45 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66" returned: 0 in 0.655s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:45 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 1073741824
Feb 27 01:29:45 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:45 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66
Feb 27 01:29:45 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:45 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-81445556-c84d-4702-89eb-725f6f35df66" returned: 0 in 0.491s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-quobyte-81445556-c84d-4702-89eb-725f6f35df66" released by "delete_volume" :: held 1.173s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Created reservations ['5fd45721-6123-46e5-8ffd-be0ef028dd9d', '1bce2d1a-6ce4-4814-b232-1ea2a46ac9da', 'c723e918-53c6-48e6-a207-ab108d36534e', '4eb21b5f-fab4-4595-8c04-5750dffd3da9'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:46 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 1073741824" returned: 0 in 0.619s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:46 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:29:46 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:46 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:29:46 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:46 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.533s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Deleted volume successfully.
Feb 27 01:29:46 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.509s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-34f35e3d-efdb-4c6f-9ccf-55c1762d23cf tempest-ServersNegativeTestJSON-1520703469 None] Lock "cinder-81445556-c84d-4702-89eb-725f6f35df66-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246d0a0c-3a58-429b-a50c-a093304bf571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09e933e-42ec-4664-8085-729145fb3be2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4c352-4410-4c07-98c4-eb68ba40242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:46 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Volume volume-e09e933e-42ec-4664-8085-729145fb3be2 (e09e933e-42ec-4664-8085-729145fb3be2): created successfully
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4c352-4410-4c07-98c4-eb68ba40242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Flow 'volume_create_manager' (21ba84f5-d670-4fd7-aaea-345a188b1a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-83e8095d-816d-42c8-b73c-5ed2d9983d7a tempest-SnapshotDependencyTests-372023647 None] Created volume successfully.
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab388aae-f7b0-4a4b-8e73-1866f7d6e60f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:47 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:29:47 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:47 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.517s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:47 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f9e81-83bd-4056-9235-93ddbf4da313]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:47 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:29:47 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:47 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.491s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.c033cb41-5c7a-4ecc-93bb-8cb6693d820dvxgl4d5s.img {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:48 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.c033cb41-5c7a-4ecc-93bb-8cb6693d820dvxgl4d5s.img
Feb 27 01:29:48 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:50 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.c033cb41-5c7a-4ecc-93bb-8cb6693d820dvxgl4d5s.img" returned: 0 in 2.223s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f28aa8-28ab-4973-bccd-a65424c54d6f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:50 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:29:50 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:50 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.757s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:50 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.c033cb41-5c7a-4ecc-93bb-8cb6693d820dvxgl4d5s.img {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:29:50 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Converted 1024.00 MB image at 460.25 MB/s
Feb 27 01:29:51 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] c033cb41-5c7a-4ecc-93bb-8cb6693d820d was raw, no need to convert to raw {{(pid=83910) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Flow 'volume_create_manager' (a5e9e1f7-63b0-4de5-8e18-09ac616ac766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a781e8-f43b-4d91-aaf4-eee7bda461f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a781e8-f43b-4d91-aaf4-eee7bda461f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1261439357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d0641b-440a-4f6b-93b9-897530422ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347be4d41e64ab9b2af75ff3e7ebf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:00Z,use_quota=True,user_id='db008878817f4ac7b6a6ef20ea6e15e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7155612f-8679-413c-a088-9a86b0508f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7155612f-8679-413c-a088-9a86b0508f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a340c88-6bbf-4240-8b1d-0ef5508aa13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a340c88-6bbf-4240-8b1d-0ef5508aa13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d0641b-440a-4f6b-93b9-897530422ceb', 'volume_name': 'volume-a5d0641b-440a-4f6b-93b9-897530422ceb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736fd715-94cf-468f-b55a-b9b928e32417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736fd715-94cf-468f-b55a-b9b928e32417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda2dcb6-3991-4b5d-92a8-4121f62808c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:00 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Volume a5d0641b-440a-4f6b-93b9-897530422ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d0641b-440a-4f6b-93b9-897530422ceb', 'volume_size': 1}
Feb 27 01:30:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.121s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Uploaded volume to glance image-id: c033cb41-5c7a-4ecc-93bb-8cb6693d820d. {{(pid=83910) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.359s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:02 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1cdf9fec-def7-4e6d-aa68-b85c40b264c8 tempest-VolumesActionsTest-1931057584 None] Copy volume to image completed successfully.
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Creating offline snapshot 9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b of volume e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b320f-6854-4d2f-b1a5-4b3efa64bc61]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:02 devstack sudo[90113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:30:02 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:02 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.581s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:02 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b 1G
Feb 27 01:30:02 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:03 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b 1G" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09e933e-42ec-4664-8085-729145fb3be2 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:03 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09e933e-42ec-4664-8085-729145fb3be2 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b
Feb 27 01:30:03 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:03 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09e933e-42ec-4664-8085-729145fb3be2 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" returned: 0 in 0.427s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:03 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b is being set with open permissions: ugo+rw
Feb 27 01:30:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:03 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b
Feb 27 01:30:03 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:04 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:04 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info
Feb 27 01:30:04 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:04 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:04 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info is being set with open permissions: ugo+rw
Feb 27 01:30:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:04 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info
Feb 27 01:30:04 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:05 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.info" returned: 0 in 0.441s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.965s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.821s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1261439357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d0641b-440a-4f6b-93b9-897530422ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347be4d41e64ab9b2af75ff3e7ebf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:00Z,use_quota=True,user_id='db008878817f4ac7b6a6ef20ea6e15e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Creating volume a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:05 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:05 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb 1073741824
Feb 27 01:30:05 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:05 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ae779779-091e-4f50-a81c-6c017603f500 tempest-SnapshotDependencyTests-372023647 None] Create snapshot completed successfully
Feb 27 01:30:05 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb 1073741824" returned: 0 in 0.570s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:05 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb
Feb 27 01:30:05 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Flow 'volume_create_manager' (090d2fe1-5452-465c-9dbb-41e60dd312b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb51cae-0ec1-4677-80ed-de0203972c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb51cae-0ec1-4677-80ed-de0203972c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4369850-768c-40fe-b1e2-6c163f2e4f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eedb29d4c84d89a5d8ce73c9c902a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:06Z,use_quota=True,user_id='4044b979c42d40dbb6f7ffebed3df520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e04af37-aed9-403d-b0c3-556f5f2732af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e04af37-aed9-403d-b0c3-556f5f2732af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2febb64-4f7c-4529-8589-e06df81e4cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2febb64-4f7c-4529-8589-e06df81e4cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4369850-768c-40fe-b1e2-6c163f2e4f13', 'volume_name': 'volume-d4369850-768c-40fe-b1e2-6c163f2e4f13', 'volume_size': 1, 'snapshot_id': '9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e046c214-c4e5-4ff2-b4d8-da1a9a180516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e046c214-c4e5-4ff2-b4d8-da1a9a180516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f361f1-3c24-4fd8-bd3c-2e644653ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Volume d4369850-768c-40fe-b1e2-6c163f2e4f13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4369850-768c-40fe-b1e2-6c163f2e4f13', 'volume_size': 1, 'snapshot_id': '9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b'}
Feb 27 01:30:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:06 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb" returned: 0 in 0.407s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.030s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda2dcb6-3991-4b5d-92a8-4121f62808c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d0641b-440a-4f6b-93b9-897530422ceb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d53f38-76fe-44cf-b755-6a53e5af9b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b7a04-da51-4b08-9243-518e75ad9a84]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Volume volume-a5d0641b-440a-4f6b-93b9-897530422ceb (a5d0641b-440a-4f6b-93b9-897530422ceb): created successfully
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d53f38-76fe-44cf-b755-6a53e5af9b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Flow 'volume_create_manager' (a5e9e1f7-63b0-4de5-8e18-09ac616ac766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:06 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-d3d39716-163c-4ab8-bf5a-63413a0a0aef req-67c1243f-fff7-488e-b11c-72cf9b266232 tempest-VolumesSnapshotsTestJSON-595186588 None] Created volume successfully.
Feb 27 01:30:06 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:30:06 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:06 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be9ea7-cd16-4406-b049-d84d41e807bc]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:06 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:30:06 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:07 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:07 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img
Feb 27 01:30:07 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:08 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img" returned: 0 in 1.797s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:08 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d7852-40a3-42fb-9e3a-53d75614d87e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:08 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:30:08 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:09 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.604s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:30:09 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Converted 1024.00 MB image at 569.26 MB/s
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] 72dd7130-4677-4cfa-9b59-885bcbcc6649 was raw, converting to qcow2 {{(pid=83910) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11bac3b-3737-4da4-9e5f-8b3ebb0ffb82]: (4, 'raw') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:09 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img
Feb 27 01:30:09 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:09 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img" returned: 0 in 0.450s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:10 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img
Feb 27 01:30:10 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:10 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img" returned: 1 in 0.443s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img' failed. Not Retrying. {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:10 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu
Feb 27 01:30:10 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:10 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu" returned: 0 in 0.386s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Image conversion details: src /opt/stack/data/cinder/conversion/79e358e1-33ad-4516-92c3-54dd7102f42f.temp_image.72dd7130-4677-4cfa-9b59-885bcbcc6649m2gemw4b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:30:10 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Converted 1024.00 MB image at 1024.00 MB/s
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e89ed8-a392-454e-a032-d9b064519f3d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:10 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu
Feb 27 01:30:10 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:11 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fzfgemwu" returned: 0 in 0.452s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.968s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Uploaded volume to glance image-id: 72dd7130-4677-4cfa-9b59-885bcbcc6649. {{(pid=83910) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.264s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-quobyte-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b-d4369850-768c-40fe-b1e2-6c163f2e4f13" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:12 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2ae73d8d-fb61-430e-b7e4-6c8591edbcc9 tempest-VolumesActionsTest-1931057584 None] Copy volume to image completed successfully.
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b-d4369850-768c-40fe-b1e2-6c163f2e4f13" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Creating volume d4369850-768c-40fe-b1e2-6c163f2e4f13 from snapshot 9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-quobyte-d4369850-768c-40fe-b1e2-6c163f2e4f13" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-d4369850-768c-40fe-b1e2-6c163f2e4f13" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] snapshot: 9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b, volume: d4369850-768c-40fe-b1e2-6c163f2e4f13,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71a20da-0067-4ba3-b1b2-00b05935f6e3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:12 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b
Feb 27 01:30:12 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:12 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" returned: 0 in 0.506s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e09e933e-42ec-4664-8085-729145fb3be2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[761739b1-9a85-4b99-b34c-de75cae224a4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:12 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:30:12 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Acquiring lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Acquiring lock "cinder-quobyte-79e358e1-33ad-4516-92c3-54dd7102f42f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Lock "cinder-quobyte-79e358e1-33ad-4516-92c3-54dd7102f42f" acquired by "delete_volume" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[026c4f29-e441-411c-bbc5-00da4c92d92e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:12 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:30:12 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:13 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:13 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:30:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:13 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13
Feb 27 01:30:13 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:13 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:13 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f
Feb 27 01:30:13 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:14 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e358e1-33ad-4516-92c3-54dd7102f42f" returned: 0 in 0.919s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Lock "cinder-quobyte-79e358e1-33ad-4516-92c3-54dd7102f42f" released by "delete_volume" :: held 1.477s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Created reservations ['56d32c3d-4980-42af-bbbc-22b4d75cb750', 'e05f994d-ca13-4fab-9ff8-a737775d759f', '7e3f1dc9-4792-4a06-90da-356dd446891d', '146d8a14-35c3-419c-947a-f26b257c285d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:14 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:14 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:15 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13" returned: 0 in 2.011s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d047572-6589-49bd-b6ba-be41ea494bb3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:15 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:30:15 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:15 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.813s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Deleted volume successfully.
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c6cfbec1-d891-4c6e-967a-5ab38651dd7e tempest-VolumesActionsTest-1931057584 None] Lock "cinder-79e358e1-33ad-4516-92c3-54dd7102f42f-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:15 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.698s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:30:15 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Converted 1024.00 MB image at 508.99 MB/s
Feb 27 01:30:15 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 is being set with open permissions: ugo+rw
Feb 27 01:30:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:15 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13
Feb 27 01:30:15 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:16 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13" returned: 0 in 0.460s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-d4369850-768c-40fe-b1e2-6c163f2e4f13" released by "_copy_volume_from_snapshot" :: held 4.255s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b-d4369850-768c-40fe-b1e2-6c163f2e4f13" released by "_create_volume_from_snapshot" :: held 4.274s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.285s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.558s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Creating offline snapshot f98afc6a-5a44-4e43-bca9-710b463402f1 of volume a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f361f1-3c24-4fd8-bd3c-2e644653ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4369850-768c-40fe-b1e2-6c163f2e4f13', 'volume_size': 1, 'snapshot_id': '9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4969fe-3d9c-4930-830b-fe516720c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[838f6013-4c98-4e6b-8d89-5fe5cfdd6194]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:16 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Volume volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 (d4369850-768c-40fe-b1e2-6c163f2e4f13): created successfully
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4969fe-3d9c-4930-830b-fe516720c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Flow 'volume_create_manager' (090d2fe1-5452-465c-9dbb-41e60dd312b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:16 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e96f64de-3e18-4801-bac7-142a6cba9f44 tempest-SnapshotDependencyTests-372023647 None] Created volume successfully.
Feb 27 01:30:16 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb
Feb 27 01:30:16 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:16 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb" returned: 0 in 0.523s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:16 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 1G
Feb 27 01:30:16 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:17 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 1G" returned: 0 in 0.549s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d0641b-440a-4f6b-93b9-897530422ceb -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:17 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d0641b-440a-4f6b-93b9-897530422ceb -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1
Feb 27 01:30:17 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-quobyte-e09e933e-42ec-4664-8085-729145fb3be2" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-e09e933e-42ec-4664-8085-729145fb3be2" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-quobyte-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Deleting offline snapshot 9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b of volume e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] snapshot_file for this snap is: volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6cee3-aabc-4f4e-83c1-75ff5a370c68]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:17 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b
Feb 27 01:30:17 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:17 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d0641b-440a-4f6b-93b9-897530422ceb -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1" returned: 0 in 0.486s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:17 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 is being set with open permissions: ugo+rw
Feb 27 01:30:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1
Feb 27 01:30:18 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:18 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" returned: 0 in 0.600s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e09e933e-42ec-4664-8085-729145fb3be2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a45c14-2009-4da2-9005-06dae6c223c3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:30:18 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:18 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1" returned: 0 in 0.471s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info
Feb 27 01:30:18 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:18 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.545s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b
Feb 27 01:30:18 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:18 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info" returned: 0 in 0.468s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:18 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info is being set with open permissions: ugo+rw
Feb 27 01:30:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info
Feb 27 01:30:18 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:19 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:19 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b
Feb 27 01:30:19 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Flow 'volume_create_manager' (183400b1-507b-4a8f-884b-db13dd535aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fba0f05-f11a-4f66-bd4a-b0ae9f4c519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fba0f05-f11a-4f66-bd4a-b0ae9f4c519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-118432742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f1d21c-af46-4103-ae1e-c93b297ee661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955fd23770504285b867bb73b5a87161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:19Z,use_quota=True,user_id='a0ea6c78860d45fd979d2ac77ebcf943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b77f8f-0fe1-475e-8a91-43f8970b7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b77f8f-0fe1-475e-8a91-43f8970b7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7844e22f-997d-42e9-90bd-d37b027778b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7844e22f-997d-42e9-90bd-d37b027778b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f1d21c-af46-4103-ae1e-c93b297ee661', 'volume_name': 'volume-79f1d21c-af46-4103-ae1e-c93b297ee661', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3fa5f8-c5a9-4e64-8552-281758a13020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3fa5f8-c5a9-4e64-8552-281758a13020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b881096c-8584-48ea-a6ac-dde24300cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:19 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Volume 79f1d21c-af46-4103-ae1e-c93b297ee661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f1d21c-af46-4103-ae1e-c93b297ee661', 'volume_size': 1}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:19 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.info" returned: 0 in 0.494s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.093s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-118432742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f1d21c-af46-4103-ae1e-c93b297ee661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955fd23770504285b867bb73b5a87161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:19Z,use_quota=True,user_id='a0ea6c78860d45fd979d2ac77ebcf943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Creating volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:19 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:19 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 1073741824
Feb 27 01:30:19 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-70c42459-e259-4130-82df-487e27400f65 req-9cad2054-05fa-4db7-89ac-d4ddc4a79bee tempest-VolumesSnapshotsTestJSON-595186588 None] Create snapshot completed successfully
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "cinder-f98afc6a-5a44-4e43-bca9-710b463402f1-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-f98afc6a-5a44-4e43-bca9-710b463402f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "cinder-quobyte-a5d0641b-440a-4f6b-93b9-897530422ceb" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-quobyte-a5d0641b-440a-4f6b-93b9-897530422ceb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "cinder-quobyte-f98afc6a-5a44-4e43-bca9-710b463402f1" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-quobyte-f98afc6a-5a44-4e43-bca9-710b463402f1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Deleting offline snapshot f98afc6a-5a44-4e43-bca9-710b463402f1 of volume a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] snapshot_file for this snap is: volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[30894b95-758d-463f-a4a8-33f37d3462fc]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:19 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2.9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" returned: 0 in 0.469s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:19 devstack sudo[90281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1
Feb 27 01:30:19 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b" released by "_delete_snapshot" :: held 2.209s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-e09e933e-42ec-4664-8085-729145fb3be2" released by "delete_snapshot" :: held 2.223s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Created reservations ['7dfe9f78-c89f-419e-80e2-0708e307a2cc', '43a75e8a-c14a-4f52-bb26-f37ff32bb6f4', 'cb0a8c03-5257-4eb5-a3e4-91f8b7b5c627', '9b83d901-2faa-4841-9657-61d5811f41c3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:19 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Delete snapshot completed successfully.
Feb 27 01:30:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4ba4bbfa-9ddf-4fbc-ac42-d3155ed09c64 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-9bae0bd8-a288-4cc1-b8ff-1d13b7472d6b-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:20 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 1073741824" returned: 0 in 0.586s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:20 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661
Feb 27 01:30:20 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:20 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1" returned: 0 in 0.471s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d0641b-440a-4f6b-93b9-897530422ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf425c9-0b4e-44b0-9a9a-3194462bcb7b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:20 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb
Feb 27 01:30:20 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:20 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661" returned: 0 in 0.415s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b881096c-8584-48ea-a6ac-dde24300cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f1d21c-af46-4103-ae1e-c93b297ee661', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b36420-bb50-45d1-9c07-82ada84e0334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Volume volume-79f1d21c-af46-4103-ae1e-c93b297ee661 (79f1d21c-af46-4103-ae1e-c93b297ee661): created successfully
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b36420-bb50-45d1-9c07-82ada84e0334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Flow 'volume_create_manager' (183400b1-507b-4a8f-884b-db13dd535aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-160452d4-d74a-460d-ab9f-95f9702b48f4 tempest-VolumesSnapshotListTestJSON-864051579 None] Created volume successfully.
Feb 27 01:30:20 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-e09e933e-42ec-4664-8085-729145fb3be2-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb" returned: 0 in 0.548s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-e09e933e-42ec-4664-8085-729145fb3be2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:20 devstack sudo[90297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1
Feb 27 01:30:20 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-quobyte-e09e933e-42ec-4664-8085-729145fb3be2" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-e09e933e-42ec-4664-8085-729145fb3be2" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a47b1f1-0fc0-4897-9df5-16bbd97cc728]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:20 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:30:20 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:21 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1" returned: 0 in 0.525s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:21 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1
Feb 27 01:30:21 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:21 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:21 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2
Feb 27 01:30:21 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Creating offline snapshot b80e65ce-b626-4f88-b6fd-c9f93faaac88 of volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c99173-a9b0-4688-ba0c-34407896b859]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:21 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661
Feb 27 01:30:21 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:21 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb.f98afc6a-5a44-4e43-bca9-710b463402f1" returned: 0 in 0.474s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-quobyte-f98afc6a-5a44-4e43-bca9-710b463402f1" released by "_delete_snapshot" :: held 2.090s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-quobyte-a5d0641b-440a-4f6b-93b9-897530422ceb" released by "delete_snapshot" :: held 2.102s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:21 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e09e933e-42ec-4664-8085-729145fb3be2" returned: 0 in 0.474s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-e09e933e-42ec-4664-8085-729145fb3be2" released by "delete_volume" :: held 1.028s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.quota [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Created reservations ['9cbf3efe-da21-49cd-9d2b-0ce72377c32f', '3d3a5e76-4ace-490e-b929-05cf2f9ac504', '51b62794-606d-42de-a822-4d1c6aa7b452', '16f4f5b4-e676-4be7-800b-1e3a9fdb5eb6'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:21 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Delete snapshot completed successfully.
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-a08d6b02-eef2-4255-88c9-ab720de3e531 req-6b0db9dc-fe2d-4676-91bf-e368d09a910b tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-f98afc6a-5a44-4e43-bca9-710b463402f1-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Created reservations ['adafbc35-ae89-4b98-b2cb-ed5fa280f7a7', '71948d3a-8f22-4fdb-acd2-ac6102b5d086', 'a1468e76-e696-4384-97f6-6f38c3b67de5', '8975936b-6c3f-42b3-8b6d-5038c372e096'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:21 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:21 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:22 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661" returned: 0 in 0.541s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:22 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 1G
Feb 27 01:30:22 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:22 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.435s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Deleted volume successfully.
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-09b764e4-67f2-4bd6-aa0d-e28488443572 tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-e09e933e-42ec-4664-8085-729145fb3be2-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:22 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 1G" returned: 0 in 0.506s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:22 devstack sudo[90326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:22 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "cinder-a5d0641b-440a-4f6b-93b9-897530422ceb-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-a5d0641b-440a-4f6b-93b9-897530422ceb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-d4369850-768c-40fe-b1e2-6c163f2e4f13-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-d4369850-768c-40fe-b1e2-6c163f2e4f13-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "cinder-quobyte-a5d0641b-440a-4f6b-93b9-897530422ceb" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-quobyte-a5d0641b-440a-4f6b-93b9-897530422ceb" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[19211dfb-e92a-44b2-b215-fc76b32efbd6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "cinder-quobyte-d4369850-768c-40fe-b1e2-6c163f2e4f13" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-d4369850-768c-40fe-b1e2-6c163f2e4f13" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a950f9-9b01-4703-9827-90a29affd7ea]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb
Feb 27 01:30:23 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13
Feb 27 01:30:23 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.470s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 is being set with open permissions: ugo+rw
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:23 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb
Feb 27 01:30:23 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13" returned: 0 in 0.526s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.432s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13
Feb 27 01:30:23 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info
Feb 27 01:30:23 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a5d0641b-440a-4f6b-93b9-897530422ceb" returned: 0 in 0.455s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-quobyte-a5d0641b-440a-4f6b-93b9-897530422ceb" released by "delete_volume" :: held 0.987s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:23 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d4369850-768c-40fe-b1e2-6c163f2e4f13" returned: 0 in 0.414s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-quobyte-d4369850-768c-40fe-b1e2-6c163f2e4f13" released by "delete_volume" :: held 0.967s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.quota [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Created reservations ['969c815b-9def-42ae-bb70-ad8fba21c1b0', '3001c04c-e8a9-4e09-a42a-58c2512f1b43', '4b4c6a14-d321-42f3-893e-38aa86a9123f', '57d74521-db50-4fba-a436-3255b58d7ad3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:24 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Created reservations ['e4bf1932-9e54-443c-ab48-4aa32ffa2e46', 'db97578e-1ea0-47aa-bf64-08e306babd1f', 'a8a35737-5678-40d3-8a06-fd897e5d68ee', 'e499e420-abab-41fb-8ce3-229925726f79'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info" returned: 0 in 0.499s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:24 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info is being set with open permissions: ugo+rw
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:24 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info
Feb 27 01:30:24 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:24 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:24 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:24 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:24 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:24 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.396s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.manager [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Deleted volume successfully.
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-9db88fc9-1b22-4ed4-a620-1cd00a210a8f req-f3721bf3-e119-47a7-8b81-16f3de729d3c tempest-VolumesSnapshotsTestJSON-595186588 None] Lock "cinder-a5d0641b-440a-4f6b-93b9-897530422ceb-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:24 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.info" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:24 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.014s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.446s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Deleted volume successfully.
Feb 27 01:30:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-46fda970-89b0-4334-a247-1ff924732e0e tempest-VolumesSnapshotListTestJSON-864051579 None] Create snapshot completed successfully
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3bd2353b-2517-416c-9c7f-87c80f45f4dd tempest-SnapshotDependencyTests-372023647 None] Lock "cinder-d4369850-768c-40fe-b1e2-6c163f2e4f13-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Creating offline snapshot 6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 of volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b349e1-3487-4360-8f33-e8da95416c79]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:24 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:24 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:25 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.509s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:25 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 1G
Feb 27 01:30:25 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:25 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 1G" returned: 0 in 0.642s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:26 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:26 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:26 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.673s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:26 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 is being set with open permissions: ugo+rw
Feb 27 01:30:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:26 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:26 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:27 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.478s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:27 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f9362461-5b50-4093-821d-42f4315867fa tempest-VolumesSnapshotListTestJSON-864051579 None] Create snapshot completed successfully
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Flow 'volume_create_manager' (c8df369c-ad30-4ac6-a920-7236007352af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702e57e6-551e-400f-bcba-c196f5387044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702e57e6-551e-400f-bcba-c196f5387044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1318010226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65a0102-3a7c-47e7-9b94-a6cd7539e9e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='146b61709aa64e3089ab18294dffb0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:28Z,use_quota=True,user_id='40fbccda78e84565a58484db1b27cc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0785a7b4-7f84-4f1f-83b0-4bc8826f2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0785a7b4-7f84-4f1f-83b0-4bc8826f2838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811abac1-8adb-446c-b14b-2532d653959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811abac1-8adb-446c-b14b-2532d653959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65a0102-3a7c-47e7-9b94-a6cd7539e9e1', 'volume_name': 'volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aa34dc-7fab-4dac-9d38-1297ee623fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aa34dc-7fab-4dac-9d38-1297ee623fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29aeab0-1946-4a30-ba90-72c022ae4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:27 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Volume b65a0102-3a7c-47e7-9b94-a6cd7539e9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1', 'volume_size': 1}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1318010226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65a0102-3a7c-47e7-9b94-a6cd7539e9e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='146b61709aa64e3089ab18294dffb0df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:28Z,use_quota=True,user_id='40fbccda78e84565a58484db1b27cc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Creating volume b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:27 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:30:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:27 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 1073741824
Feb 27 01:30:27 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:28 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 1073741824" returned: 0 in 0.616s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:28 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1
Feb 27 01:30:28 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:28 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1" returned: 0 in 0.428s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.755s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29aeab0-1946-4a30-ba90-72c022ae4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac7cca4-429d-4889-83fc-7933f133483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Creating offline snapshot c1276662-0461-464f-aafe-d0ff9646fe49 of volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:28 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Volume volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 (b65a0102-3a7c-47e7-9b94-a6cd7539e9e1): created successfully
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac7cca4-429d-4889-83fc-7933f133483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Flow 'volume_create_manager' (c8df369c-ad30-4ac6-a920-7236007352af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e10f2f-eb91-43b1-9295-ac09e7ea8dc6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-25355912-db0d-4ae5-9867-7b1cacb50884 req-bc3e1331-8b65-420a-8bd6-51b4e3ede4cc tempest-VolumesGetTestJSON-1210760804 None] Created volume successfully.
Feb 27 01:30:29 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:29 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:29 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.586s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:29 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 1G
Feb 27 01:30:29 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Acquiring lock "cinder-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Lock "cinder-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Acquiring lock "cinder-quobyte-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Lock "cinder-quobyte-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e881dbda-9238-4182-8da5-49121882813e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 1G" returned: 0 in 0.645s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49
Feb 27 01:30:30 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1
Feb 27 01:30:30 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:30 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 is being set with open permissions: ugo+rw
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49
Feb 27 01:30:30 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1" returned: 0 in 0.640s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1
Feb 27 01:30:30 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:30 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:31 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49" returned: 0 in 0.466s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:31 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-928c54bd-ccea-4843-ad03-5796898801be tempest-VolumesSnapshotListTestJSON-864051579 None] Create snapshot completed successfully
Feb 27 01:30:31 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1" returned: 0 in 0.514s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Lock "cinder-quobyte-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1" released by "delete_volume" :: held 1.191s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=90,cinder:UPDATE=97,cinder:INSERT=26,cinder:DELETE=8 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.quota [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Created reservations ['24b33660-81f9-4444-8434-64045d3ca86f', 'affa9d64-4442-48f8-8c6e-fafb18d880df', '899f083e-9c0b-4946-9a7b-4500e8498ac6', '33853583-35b6-4de0-abd5-5f2ef394c71f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:31 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.629s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:31 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:31 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-c1276662-0461-464f-aafe-d0ff9646fe49-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-c1276662-0461-464f-aafe-d0ff9646fe49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:31 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-c1276662-0461-464f-aafe-d0ff9646fe49" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-c1276662-0461-464f-aafe-d0ff9646fe49" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Deleting offline snapshot c1276662-0461-464f-aafe-d0ff9646fe49 of volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:32 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] snapshot_file for this snap is: volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.624s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG cinder.manager [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:32 devstack cinder-volume[83910]: INFO cinder.volume.manager [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Deleted volume successfully.
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728e3ba-7f77-4622-a1a3-22b8f1b24ad3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG cinder.coordination [req-721e0869-d68a-4ce3-a95d-ab3226a3bdae req-6b94ffb2-2623-4fc4-833c-72429b10a18c tempest-VolumesGetTestJSON-1210760804 None] Lock "cinder-b65a0102-3a7c-47e7-9b94-a6cd7539e9e1-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:32 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49
Feb 27 01:30:32 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:32 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49" returned: 0 in 0.575s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0e1d7-e38b-4722-a23c-6fba37bdf78f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:32 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:32 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:33 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.520s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:33 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:33 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49
Feb 27 01:30:33 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:33 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49" returned: 0 in 0.539s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:33 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49
Feb 27 01:30:33 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:34 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.c1276662-0461-464f-aafe-d0ff9646fe49" returned: 0 in 0.494s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-c1276662-0461-464f-aafe-d0ff9646fe49" released by "_delete_snapshot" :: held 2.204s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" released by "delete_snapshot" :: held 2.221s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:34 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=80,cinder:UPDATE=94,cinder:INSERT=17,cinder:DELETE=10 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:30:34 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Created reservations ['90adb38e-f605-4655-9056-a7a6073395b3', 'fc3fe7a9-9528-428a-a707-a2ce98ccc48e', '1699d749-3ee0-4b5e-b615-169b1860d33f', 'fc573292-58b2-4986-a624-07c23c6741b8'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:34 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Delete snapshot completed successfully.
Feb 27 01:30:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-eb2c3c88-e58a-4160-a7e5-61f3f5453a2d tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-c1276662-0461-464f-aafe-d0ff9646fe49-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Deleting offline snapshot 6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 of volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] snapshot_file for this snap is: volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b435d-3562-462a-8f8b-c67a94ba0a56]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:35 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:35 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:35 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.546s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d6e6e-0a56-4cd5-8fd9-940c2fc8989a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:35 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:35 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:36 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:36 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:36 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:36 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:36 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1
Feb 27 01:30:36 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:37 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" returned: 0 in 0.421s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1" released by "_delete_snapshot" :: held 1.990s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" released by "delete_snapshot" :: held 2.003s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:37 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Created reservations ['1ec3301c-c56d-46d8-85d5-f1b5f563dab8', 'bbfb8927-2d74-4199-9356-a8b1f8359ebd', '51263999-da3c-43d3-b42e-62b57709fd33', '2974c4b8-269f-47b8-9c32-8cb90d2113b6'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:37 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Delete snapshot completed successfully.
Feb 27 01:30:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-258716fb-9813-4b8a-9b05-418bfe5d750c tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-6d1b4f8e-1215-4a2e-8c0f-2484d35dabd1-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-800d6b4c-c427-45d6-935c-fe21096922fc tempest-BackendsCapabilitiesAdminTestsJSON-1873204701 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6537017822266, 'free_capacity_gb': 1775.6537017822266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83910) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ec845965-8f93-4fb3-99eb-f6ed1037e23c tempest-BackendsCapabilitiesAdminTestsJSON-1873204701 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6537017822266, 'free_capacity_gb': 1775.6537017822266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83910) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-b80e65ce-b626-4f88-b6fd-c9f93faaac88-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-b80e65ce-b626-4f88-b6fd-c9f93faaac88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-b80e65ce-b626-4f88-b6fd-c9f93faaac88" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-b80e65ce-b626-4f88-b6fd-c9f93faaac88" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Deleting offline snapshot b80e65ce-b626-4f88-b6fd-c9f93faaac88 of volume 79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] snapshot_file for this snap is: volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c8288-b908-458d-a8d0-80104d6804f8]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:38 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:38 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:38 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.581s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f1d21c-af46-4103-ae1e-c93b297ee661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2626a-841a-4997-b410-14af940610ae]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:39 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661
Feb 27 01:30:39 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:39 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661" returned: 0 in 0.621s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:39 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:39 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:40 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.540s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:40 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88
Feb 27 01:30:40 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:40 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661.b80e65ce-b626-4f88-b6fd-c9f93faaac88" returned: 0 in 0.469s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-b80e65ce-b626-4f88-b6fd-c9f93faaac88" released by "_delete_snapshot" :: held 2.275s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" released by "delete_snapshot" :: held 2.292s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Created reservations ['d0ce3b8a-ba15-41fd-a756-00bb97140f85', '7a6932cc-1e5f-4960-9bcf-0c7fe064cf0f', 'd61d14a2-f3ed-4e1a-8aeb-0df1572afb9c', 'e22eb6b3-300d-41e6-8b2a-1ebc8916f36f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Delete snapshot completed successfully.
Feb 27 01:30:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b69eec79-a41a-4a3a-9f97-ce79ead610bc tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-b80e65ce-b626-4f88-b6fd-c9f93faaac88-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-79f1d21c-af46-4103-ae1e-c93b297ee661-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-79f1d21c-af46-4103-ae1e-c93b297ee661-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:41 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c87f7e-2878-489e-84ca-0656cf9f7c5d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:41 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661
Feb 27 01:30:41 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:42 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661" returned: 0 in 0.528s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:42 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661
Feb 27 01:30:42 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:42 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f1d21c-af46-4103-ae1e-c93b297ee661" returned: 0 in 0.470s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-quobyte-79f1d21c-af46-4103-ae1e-c93b297ee661" released by "delete_volume" :: held 1.037s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Created reservations ['8e9e61fe-a361-402d-84fb-eab9cdced4ad', 'ba96e78c-c658-4ae6-9ad5-c59c583c38b8', '13d90879-5c70-4688-a116-a31f8c04f791', '279e4111-8abf-444c-92cc-2a016d74280c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:42 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:42 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:43 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.427s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:43 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Deleted volume successfully.
Feb 27 01:30:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-db005501-367a-42f3-af13-3decdf09bd18 tempest-VolumesSnapshotListTestJSON-864051579 None] Lock "cinder-79f1d21c-af46-4103-ae1e-c93b297ee661-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-47485654-9399-4f6e-be0e-5d8bae75fff2 tempest-GroupsTest-2099598983 None] Group tempest-Group1-1005892072: creating
Feb 27 01:30:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-47485654-9399-4f6e-be0e-5d8bae75fff2 tempest-GroupsTest-2099598983 None] Group tempest-Group1-1005892072: created successfully
Feb 27 01:30:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-47485654-9399-4f6e-be0e-5d8bae75fff2 tempest-GroupsTest-2099598983 None] Create group completed successfully.
Feb 27 01:30:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-688b7aa8-6bdc-47db-906f-d02ea288d68e tempest-GroupsTest-2099598983 None] Group tempest-Group2-959653356: creating
Feb 27 01:30:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-688b7aa8-6bdc-47db-906f-d02ea288d68e tempest-GroupsTest-2099598983 None] Group tempest-Group2-959653356: created successfully
Feb 27 01:30:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-688b7aa8-6bdc-47db-906f-d02ea288d68e tempest-GroupsTest-2099598983 None] Create group completed successfully.
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Flow 'volume_create_manager' (87a88e99-68f7-4238-a65d-029d876499b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14db899c-05dd-49f6-a2d6-af34b24225b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14db899c-05dd-49f6-a2d6-af34b24225b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-347509913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a46c232-e688-488d-b039-918544f27e71,host='devstack@QuobyteHD#QuobyteHD',id=c07146ac-ec72-4a70-adf3-4d3bb13ab10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2901227eb7d74feab579ced0f4a03a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:48Z,use_quota=True,user_id='1fc7fc2575e747dc9f63b57176a49370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2c9f82a-c1c3-481c-a9c8-47c33a382b8a),volume_type_id=e2c9f82a-c1c3-481c-a9c8-47c33a382b8a)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe057a5-8791-4f64-be97-6293d6c55abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe057a5-8791-4f64-be97-6293d6c55abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02544da5-4e1f-4970-84a6-51abe9d4c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02544da5-4e1f-4970-84a6-51abe9d4c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07146ac-ec72-4a70-adf3-4d3bb13ab10f', 'volume_name': 'volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b37eabe-2213-4e2b-a047-db7961a297d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b37eabe-2213-4e2b-a047-db7961a297d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d997501-f90c-4772-9335-84dff675239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:47 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Volume c07146ac-ec72-4a70-adf3-4d3bb13ab10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f', 'volume_size': 1}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8a46c232-e688-488d-b039-918544f27e71,created_at=2026-02-27T00:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-347509913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a46c232-e688-488d-b039-918544f27e71,host='devstack@QuobyteHD#QuobyteHD',id=c07146ac-ec72-4a70-adf3-4d3bb13ab10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2901227eb7d74feab579ced0f4a03a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:48Z,use_quota=True,user_id='1fc7fc2575e747dc9f63b57176a49370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2c9f82a-c1c3-481c-a9c8-47c33a382b8a),volume_type_id=e2c9f82a-c1c3-481c-a9c8-47c33a382b8a)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Creating volume c07146ac-ec72-4a70-adf3-4d3bb13ab10f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:47 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:30:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:47 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f 1073741824
Feb 27 01:30:47 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:48 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f 1073741824" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:48 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f
Feb 27 01:30:48 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:48 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f" returned: 0 in 0.441s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d997501-f90c-4772-9335-84dff675239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d467e7-5120-4fca-bc50-ceb382e252a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:48 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Volume volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f (c07146ac-ec72-4a70-adf3-4d3bb13ab10f): created successfully
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d467e7-5120-4fca-bc50-ceb382e252a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Flow 'volume_create_manager' (87a88e99-68f7-4238-a65d-029d876499b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5c87bd7a-96e3-416f-8394-fedcc92cb51f tempest-GroupsTest-2099598983 None] Created volume successfully.
Feb 27 01:30:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Acquiring lock "cinder-quobyte-c07146ac-ec72-4a70-adf3-4d3bb13ab10f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Lock "cinder-quobyte-c07146ac-ec72-4a70-adf3-4d3bb13ab10f" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e70e7e-f91b-4a9e-af1f-e70a603e1b72]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:50 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f
Feb 27 01:30:50 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:50 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f" returned: 0 in 0.500s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:50 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f
Feb 27 01:30:50 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:51 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c07146ac-ec72-4a70-adf3-4d3bb13ab10f" returned: 0 in 0.410s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Lock "cinder-quobyte-c07146ac-ec72-4a70-adf3-4d3bb13ab10f" released by "delete_volume" :: held 0.935s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Created reservations ['9352b249-70b1-4cae-ad51-ace257b843b3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:51 devstack cinder-volume[83910]: WARNING cinder.quota [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1309781527 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1309781527, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:30:51 devstack cinder-volume[83910]: WARNING cinder.quota [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1309781527 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1309781527, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Created reservations ['5725c36d-6ded-4d85-8bcb-5ca6a87f9cdc', 'd708e1c3-1eb0-4bcd-9c65-8c624eda81e0', '3bb3dda3-9194-43cb-8eed-721bd3a3a1cb', '72a75d0c-0c56-48c5-bd19-325c62edf6b3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:51 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:51 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Created reservations ['d73bb84a-b8bc-44ee-a1dc-997387647bcb'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:51 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:30:51 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:51 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.440s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:51 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ca9b06d8-7ff2-4eec-8710-bf7ce89df380 tempest-GroupsTest-2099598983 None] Delete group completed successfully.
Feb 27 01:30:51 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:51 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:51 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-fda1f3e8-680a-4af8-be39-d6d5586a0769 tempest-GroupsTest-2099598983 None] Delete group completed successfully.
Feb 27 01:30:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-da759e35-af52-413c-9667-7a2cef054255 tempest-GroupsTest-2099598983 None] Group tempest-GroupsTest-Group-816219412: creating
Feb 27 01:30:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-da759e35-af52-413c-9667-7a2cef054255 tempest-GroupsTest-2099598983 None] Group tempest-GroupsTest-Group-816219412: created successfully
Feb 27 01:30:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-da759e35-af52-413c-9667-7a2cef054255 tempest-GroupsTest-2099598983 None] Create group completed successfully.
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Flow 'volume_create_manager' (1c1e1c5c-e10e-4605-b93c-305b614c4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5534c764-a674-400c-a5c6-66f4bfdc8d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5534c764-a674-400c-a5c6-66f4bfdc8d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-645900797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f2d1138-808e-484c-ab1a-8f3fb99e5149,host='devstack@QuobyteHD#QuobyteHD',id=97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2901227eb7d74feab579ced0f4a03a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:54Z,use_quota=True,user_id='1fc7fc2575e747dc9f63b57176a49370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b687a73-58e3-4cdd-b7d4-de4192752474),volume_type_id=6b687a73-58e3-4cdd-b7d4-de4192752474)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7edf27-4d32-4944-b5eb-2ac411ad292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7edf27-4d32-4944-b5eb-2ac411ad292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1924c160-3e17-4075-a07f-278f56dfa14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1924c160-3e17-4075-a07f-278f56dfa14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa', 'volume_name': 'volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfa9dd9-6e0c-4814-b9b6-1ac68cc68507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfa9dd9-6e0c-4814-b9b6-1ac68cc68507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ae0724-bebd-40ca-a60b-a5c9719fe0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:54 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Volume 97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa', 'volume_size': 1}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f2d1138-808e-484c-ab1a-8f3fb99e5149,created_at=2026-02-27T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-645900797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f2d1138-808e-484c-ab1a-8f3fb99e5149,host='devstack@QuobyteHD#QuobyteHD',id=97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2901227eb7d74feab579ced0f4a03a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:54Z,use_quota=True,user_id='1fc7fc2575e747dc9f63b57176a49370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b687a73-58e3-4cdd-b7d4-de4192752474),volume_type_id=6b687a73-58e3-4cdd-b7d4-de4192752474)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Creating volume 97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:54 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:54 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa 1073741824
Feb 27 01:30:54 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:54 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa 1073741824" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:54 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa
Feb 27 01:30:54 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:55 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa" returned: 0 in 0.391s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ae0724-bebd-40ca-a60b-a5c9719fe0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d071a568-c42c-4b6c-bc32-96a8415eaf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Volume volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa (97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa): created successfully
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d071a568-c42c-4b6c-bc32-96a8415eaf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Flow 'volume_create_manager' (1c1e1c5c-e10e-4605-b93c-305b614c4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-12230201-e94b-466f-9da3-8b28c55be1d2 tempest-GroupsTest-2099598983 None] Created volume successfully.
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Flow 'volume_create_manager' (662a43d9-9205-43ad-96b3-f5ea9f96f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8fae515-be33-4067-b035-038ac6c6d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8fae515-be33-4067-b035-038ac6c6d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379703732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f2d1138-808e-484c-ab1a-8f3fb99e5149,host='devstack@QuobyteHD#QuobyteHD',id=af902705-28d6-40a2-9d20-c3c8bd8202e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2901227eb7d74feab579ced0f4a03a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:56Z,use_quota=True,user_id='1fc7fc2575e747dc9f63b57176a49370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b687a73-58e3-4cdd-b7d4-de4192752474),volume_type_id=6b687a73-58e3-4cdd-b7d4-de4192752474)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930d2f1c-38dc-47e0-a85c-091f21ce2746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930d2f1c-38dc-47e0-a85c-091f21ce2746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e42abbf-b53a-4dc5-9a1f-6598f6291b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e42abbf-b53a-4dc5-9a1f-6598f6291b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af902705-28d6-40a2-9d20-c3c8bd8202e7', 'volume_name': 'volume-af902705-28d6-40a2-9d20-c3c8bd8202e7', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89be79-0693-4c47-a038-af3028ad19fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89be79-0693-4c47-a038-af3028ad19fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737cf94a-290c-43a1-abab-321d08455e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Volume af902705-28d6-40a2-9d20-c3c8bd8202e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af902705-28d6-40a2-9d20-c3c8bd8202e7', 'volume_size': 1}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f2d1138-808e-484c-ab1a-8f3fb99e5149,created_at=2026-02-27T00:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379703732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f2d1138-808e-484c-ab1a-8f3fb99e5149,host='devstack@QuobyteHD#QuobyteHD',id=af902705-28d6-40a2-9d20-c3c8bd8202e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2901227eb7d74feab579ced0f4a03a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:56Z,use_quota=True,user_id='1fc7fc2575e747dc9f63b57176a49370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b687a73-58e3-4cdd-b7d4-de4192752474),volume_type_id=6b687a73-58e3-4cdd-b7d4-de4192752474)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Creating volume af902705-28d6-40a2-9d20-c3c8bd8202e7 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:55 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:30:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:55 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 1073741824
Feb 27 01:30:55 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:56 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 1073741824" returned: 0 in 0.456s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:56 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7
Feb 27 01:30:56 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:56 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7" returned: 0 in 0.398s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737cf94a-290c-43a1-abab-321d08455e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af902705-28d6-40a2-9d20-c3c8bd8202e7', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b943de2d-aa69-4fa0-97ac-b65be7e2fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Volume volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 (af902705-28d6-40a2-9d20-c3c8bd8202e7): created successfully
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b943de2d-aa69-4fa0-97ac-b65be7e2fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Flow 'volume_create_manager' (662a43d9-9205-43ad-96b3-f5ea9f96f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-69025037-5cfc-4d61-aba9-633c8ecd0bd3 tempest-GroupsTest-2099598983 None] Created volume successfully.
Feb 27 01:30:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-49946d81-c658-47f6-89af-3362273ca393 tempest-GroupsTest-2099598983 None] Update group completed successfully.
Feb 27 01:30:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-62f3a8ca-37b7-4877-9b8e-4f10f095d336 tempest-GroupsTest-2099598983 None] Update group completed successfully.
Feb 27 01:30:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Acquiring lock "cinder-quobyte-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Lock "cinder-quobyte-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ffd17c-e955-489b-922a-65ee74c8dabd]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:59 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa
Feb 27 01:30:59 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:59 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa" returned: 0 in 0.510s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:59 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa
Feb 27 01:30:59 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:00 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa" returned: 0 in 0.424s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Lock "cinder-quobyte-97bc5c2c-74f6-4263-b39f-b13d5dd2b7fa" released by "delete_volume" :: held 0.959s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Acquiring lock "cinder-quobyte-af902705-28d6-40a2-9d20-c3c8bd8202e7" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Lock "cinder-quobyte-af902705-28d6-40a2-9d20-c3c8bd8202e7" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb25e2-e2a6-4487-a746-bf7bfc8d6847]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:00 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7
Feb 27 01:31:00 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:00 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7" returned: 0 in 0.486s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:00 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7
Feb 27 01:31:00 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:01 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-af902705-28d6-40a2-9d20-c3c8bd8202e7" returned: 0 in 0.427s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Lock "cinder-quobyte-af902705-28d6-40a2-9d20-c3c8bd8202e7" released by "delete_volume" :: held 0.934s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Created reservations ['34132715-dc46-44d8-990d-261509f0fa1d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:01 devstack cinder-volume[83910]: WARNING cinder.quota [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2048650523 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2048650523, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:31:01 devstack cinder-volume[83910]: WARNING cinder.quota [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2048650523 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2048650523, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Created reservations ['32a701b7-1aa1-4d93-96a1-d3e5fdd4a291', '003b84a7-d413-484f-8209-3e835f09bf37', '2938275e-aba6-4494-b6e3-3dec271d90f0', '6f8b43b1-7fe2-41b2-8332-d9bd610673bf'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Created reservations ['9a6d8439-1b98-4df7-b056-0402803225ba', '9996ce44-d87e-476a-b8f9-9847b6fcf28c', 'c63262f5-76a4-4304-bb46-9dca19f72bd5', 'fa0df208-3661-41f9-a58a-c9bf08209df6'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:01 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:31:01 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:01 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:01 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:01 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6fdc51fc-3531-46ec-8bce-955d1f30b0c5 tempest-GroupsTest-2099598983 None] Delete group completed successfully.
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Flow 'volume_create_manager' (2119cc60-0ba4-476d-980d-1399df30bbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33159b3f-0cc7-48e5-a6ab-224774b4df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33159b3f-0cc7-48e5-a6ab-224774b4df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-173919222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba65e6dc-8271-4eac-b070-80be6532e336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7f4a8f8f2644589ee47eb7c9ea8ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:09Z,use_quota=True,user_id='cfd29e8398614d1f9bee58916382360b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b04e086c-f4d7-4295-80ac-19b65adcd960),volume_type_id=b04e086c-f4d7-4295-80ac-19b65adcd960)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa80c3b-384a-4204-82d2-53b454d0df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa80c3b-384a-4204-82d2-53b454d0df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d355fe24-13bf-4edf-80f8-23bcf46a3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d355fe24-13bf-4edf-80f8-23bcf46a3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba65e6dc-8271-4eac-b070-80be6532e336', 'volume_name': 'volume-ba65e6dc-8271-4eac-b070-80be6532e336', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d78b3a8-414b-414f-beac-8a69469c64e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d78b3a8-414b-414f-beac-8a69469c64e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a321c3-7727-43a3-8d54-884913cebef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Volume ba65e6dc-8271-4eac-b070-80be6532e336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba65e6dc-8271-4eac-b070-80be6532e336', 'volume_size': 1}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-173919222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba65e6dc-8271-4eac-b070-80be6532e336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7f4a8f8f2644589ee47eb7c9ea8ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:09Z,use_quota=True,user_id='cfd29e8398614d1f9bee58916382360b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b04e086c-f4d7-4295-80ac-19b65adcd960),volume_type_id=b04e086c-f4d7-4295-80ac-19b65adcd960)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Creating volume ba65e6dc-8271-4eac-b070-80be6532e336 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:08 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:31:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:08 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336 1073741824
Feb 27 01:31:08 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:09 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336 1073741824" returned: 0 in 0.514s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:09 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336
Feb 27 01:31:09 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:09 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336" returned: 0 in 0.456s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a321c3-7727-43a3-8d54-884913cebef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba65e6dc-8271-4eac-b070-80be6532e336', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7802f7ae-0a3c-4428-82d1-e5e93d9d256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:09 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Volume volume-ba65e6dc-8271-4eac-b070-80be6532e336 (ba65e6dc-8271-4eac-b070-80be6532e336): created successfully
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7802f7ae-0a3c-4428-82d1-e5e93d9d256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Flow 'volume_create_manager' (2119cc60-0ba4-476d-980d-1399df30bbda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:09 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-7485a421-ecf5-4ec0-9792-2389b77644c0 tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Created volume successfully.
Feb 27 01:31:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:11 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:31:11 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:11 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:11 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d1b6296c-91b0-458f-97e1-f02e136d23ec tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Retype volume completed successfully.
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Acquiring lock "cinder-ba65e6dc-8271-4eac-b070-80be6532e336-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "cinder-ba65e6dc-8271-4eac-b070-80be6532e336-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Acquiring lock "cinder-quobyte-ba65e6dc-8271-4eac-b070-80be6532e336" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "cinder-quobyte-ba65e6dc-8271-4eac-b070-80be6532e336" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e87518-52e1-4388-b12d-7f1d78d31c74]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:12 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336
Feb 27 01:31:12 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:12 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336" returned: 0 in 0.540s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:12 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336
Feb 27 01:31:12 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:13 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ba65e6dc-8271-4eac-b070-80be6532e336" returned: 0 in 0.534s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "cinder-quobyte-ba65e6dc-8271-4eac-b070-80be6532e336" released by "delete_volume" :: held 1.100s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:13 devstack cinder-volume[83910]: WARNING cinder.quota [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:31:13 devstack cinder-volume[83910]: WARNING cinder.quota [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Created reservations ['f35deb67-3885-4aae-8b2e-8373f5ce7058', 'dd04b262-cc3a-4fbe-a634-dd89ab620c01', 'cec3f111-2a16-44ab-98c8-3c6fd4cb423b', 'de813673-bc15-470e-b0d2-057100b44645'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:13 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:31:13 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:13 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.416s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Deleted volume successfully.
Feb 27 01:31:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-efe9a7bb-da09-409d-82a5-e0b73db7faad tempest-VolumeRetypeWithoutMigrationTest-991065966 None] Lock "cinder-ba65e6dc-8271-4eac-b070-80be6532e336-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:23 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:INSERT=20,cinder:UPDATE=84,cinder:SELECT=71,cinder:DELETE=3 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:31:23 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=86,cinder:INSERT=23,cinder:UPDATE=92,cinder:DELETE=4 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:30 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:31:30 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:31 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.480s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (6d718da1-51f4-4e35-b147-7b28fb261450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63150e4-ee38-4bcf-b881-2befbadc9527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63150e4-ee38-4bcf-b881-2befbadc9527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-42865272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:52Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fa4aec-ceee-4874-8727-f147db2c8176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fa4aec-ceee-4874-8727-f147db2c8176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212b0baf-6d13-4845-b497-c77a26125421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212b0baf-6d13-4845-b497-c77a26125421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1', 'volume_name': 'volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0719ad37-7725-4df4-b5f2-a4e431ae9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0719ad37-7725-4df4-b5f2-a4e431ae9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c348f254-9258-4df8-a2e1-4cc4771f4f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Volume 5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1', 'volume_size': 1}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-42865272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:52Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Creating volume 5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:51 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:31:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:51 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 1073741824
Feb 27 01:31:51 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:52 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 1073741824" returned: 0 in 0.493s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:52 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1
Feb 27 01:31:52 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:52 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" returned: 0 in 0.427s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c348f254-9258-4df8-a2e1-4cc4771f4f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522ab6aa-8b12-46ae-89fb-ca9b557ebbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Volume volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 (5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1): created successfully
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522ab6aa-8b12-46ae-89fb-ca9b557ebbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (6d718da1-51f4-4e35-b147-7b28fb261450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c3c9a7e8-0074-4846-b600-53097659fadf tempest-VolumesActionsTest-481100502 None] Created volume successfully.
Feb 27 01:31:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c07f58ba-e606-4f82-911d-4d67660c91ec tempest-VolumesActionsTest-481100502 None] Acquiring lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" by "attach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c07f58ba-e606-4f82-911d-4d67660c91ec tempest-VolumesActionsTest-481100502 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" acquired by "attach_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:53 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c07f58ba-e606-4f82-911d-4d67660c91ec tempest-VolumesActionsTest-481100502 None] Attaching volume 5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 to instance faa36eb2-75d7-4cf6-bc45-586fa69d4cbf at mountpoint /dev/vdb on host None.
Feb 27 01:31:53 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c07f58ba-e606-4f82-911d-4d67660c91ec tempest-VolumesActionsTest-481100502 None] Attach volume completed successfully.
Feb 27 01:31:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c07f58ba-e606-4f82-911d-4d67660c91ec tempest-VolumesActionsTest-481100502 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" released by "attach_volume" :: held 0.063s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:54 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-817c501f-a66c-416d-8a6f-977786ef5023 tempest-VolumesActionsTest-300883864 None] Terminate volume connection completed successfully.
Feb 27 01:31:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-817c501f-a66c-416d-8a6f-977786ef5023 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-detach_volume" by "detach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-817c501f-a66c-416d-8a6f-977786ef5023 tempest-VolumesActionsTest-300883864 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-817c501f-a66c-416d-8a6f-977786ef5023 tempest-VolumesActionsTest-300883864 None] Detaching volume 5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 from instance faa36eb2-75d7-4cf6-bc45-586fa69d4cbf.
Feb 27 01:31:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-817c501f-a66c-416d-8a6f-977786ef5023 tempest-VolumesActionsTest-300883864 None] Detach volume completed successfully.
Feb 27 01:31:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-817c501f-a66c-416d-8a6f-977786ef5023 tempest-VolumesActionsTest-300883864 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79828b3d-3b91-449f-81f5-1feea98b740b tempest-VolumesActionsTest-481100502 None] Acquiring lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-detach_volume" by "detach_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79828b3d-3b91-449f-81f5-1feea98b740b tempest-VolumesActionsTest-481100502 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-79828b3d-3b91-449f-81f5-1feea98b740b tempest-VolumesActionsTest-481100502 None] Volume detach called, but volume not attached.
Feb 27 01:31:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-79828b3d-3b91-449f-81f5-1feea98b740b tempest-VolumesActionsTest-481100502 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Acquiring lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Acquiring lock "cinder-quobyte-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Lock "cinder-quobyte-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0eb432-5948-4799-9a04-9ea2ce3794fa]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:56 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1
Feb 27 01:31:56 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:57 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" returned: 0 in 0.526s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:57 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1
Feb 27 01:31:57 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:57 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" returned: 0 in 0.439s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Lock "cinder-quobyte-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1" released by "delete_volume" :: held 0.986s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Created reservations ['3e85e6f6-eeed-4a69-9a1a-b4ba2bc200b5', 'a84a748b-02dd-4ac5-b74a-7e1831e88f48', '891e6b20-83ed-461b-aeb5-50fb8735ad79', 'eb907fef-95ce-4699-9743-d26f23f47ea8'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:57 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:31:57 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:58 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:58 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:58 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Deleted volume successfully.
Feb 27 01:31:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d856f3de-b240-4778-98a8-4a3aa5af6f4f tempest-VolumesActionsTest-481100502 None] Lock "cinder-5f562fbc-4ea5-4ac4-a142-c8ee9a0494b1-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (58c2eaf1-245b-4bb6-89c2-dbd79c2a6972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb126d11-e506-4b5d-ad61-54321bd96962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb126d11-e506-4b5d-ad61-54321bd96962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607050027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e4c3d1-78c9-435c-aa01-48ef478187fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:06Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d1f59d-9e6a-494b-95b1-759094c2551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d1f59d-9e6a-494b-95b1-759094c2551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecac2e53-9186-4381-ac59-8a4678352e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecac2e53-9186-4381-ac59-8a4678352e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e4c3d1-78c9-435c-aa01-48ef478187fa', 'volume_name': 'volume-95e4c3d1-78c9-435c-aa01-48ef478187fa', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfe4035-88cc-42e7-9831-8e16bf8b27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfe4035-88cc-42e7-9831-8e16bf8b27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8908fec-21a1-45ef-ace5-968d82ce585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Volume 95e4c3d1-78c9-435c-aa01-48ef478187fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e4c3d1-78c9-435c-aa01-48ef478187fa', 'volume_size': 1}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607050027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e4c3d1-78c9-435c-aa01-48ef478187fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:06Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Creating volume 95e4c3d1-78c9-435c-aa01-48ef478187fa {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:06 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:06 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa 1073741824
Feb 27 01:32:06 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:06 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa 1073741824" returned: 0 in 0.546s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:06 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa
Feb 27 01:32:06 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:07 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8908fec-21a1-45ef-ace5-968d82ce585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e4c3d1-78c9-435c-aa01-48ef478187fa', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d86224-7224-43cc-ac63-70d48add7acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:07 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Volume volume-95e4c3d1-78c9-435c-aa01-48ef478187fa (95e4c3d1-78c9-435c-aa01-48ef478187fa): created successfully
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d86224-7224-43cc-ac63-70d48add7acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (58c2eaf1-245b-4bb6-89c2-dbd79c2a6972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9de07d3c-6e32-4cec-bea6-fb212c768fba tempest-VolumesActionsTest-481100502 None] Created volume successfully.
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-95e4c3d1-78c9-435c-aa01-48ef478187fa-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Lock "cinder-95e4c3d1-78c9-435c-aa01-48ef478187fa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-quobyte-95e4c3d1-78c9-435c-aa01-48ef478187fa" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-95e4c3d1-78c9-435c-aa01-48ef478187fa" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ee7e4-ecf7-47ad-9ec7-aee5f187b2c4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:08 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa
Feb 27 01:32:08 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:08 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:08 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa
Feb 27 01:32:08 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-95e4c3d1-78c9-435c-aa01-48ef478187fa" returned: 0 in 0.408s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-95e4c3d1-78c9-435c-aa01-48ef478187fa" released by "delete_volume" :: held 0.912s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Created reservations ['ecfcf545-0424-4f90-9a93-0f8528d6777d', '5934d066-5237-4fd9-9e09-60c11c17e5a7', '15d21b69-cce7-4b3b-8049-19d6a19647f8', '74f75716-7b4e-4070-9465-ac88bfb9a78b'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:09 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (17913bcb-41d4-4f4e-a4d9-efc34a2cfd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6209448c-13ae-4d9e-ba9a-cf302e4a1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6209448c-13ae-4d9e-ba9a-cf302e4a1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936415148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d93315e-6842-499e-8ed3-6d7e8bf40235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:10Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae378efb-49a2-4758-8b3d-88a0a7842155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae378efb-49a2-4758-8b3d-88a0a7842155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118abff-ad47-42ec-8f09-e1abbb40b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118abff-ad47-42ec-8f09-e1abbb40b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d93315e-6842-499e-8ed3-6d7e8bf40235', 'volume_name': 'volume-0d93315e-6842-499e-8ed3-6d7e8bf40235', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277c3b90-de65-4f9b-bea5-cd6c78911a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277c3b90-de65-4f9b-bea5-cd6c78911a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074a7c9e-3b55-4181-94a6-e18f9e560dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:09 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Volume 0d93315e-6842-499e-8ed3-6d7e8bf40235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d93315e-6842-499e-8ed3-6d7e8bf40235', 'volume_size': 1}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936415148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d93315e-6842-499e-8ed3-6d7e8bf40235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:10Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Creating volume 0d93315e-6842-499e-8ed3-6d7e8bf40235 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:09 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 1073741824
Feb 27 01:32:09 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:09 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Deleted volume successfully.
Feb 27 01:32:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d9df42ab-f321-4894-b6f4-aa0f67c59c3b tempest-VolumesActionsTest-300883864 None] Lock "cinder-95e4c3d1-78c9-435c-aa01-48ef478187fa-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:10 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 1073741824" returned: 0 in 0.502s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:10 devstack sudo[90795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235
Feb 27 01:32:10 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:10 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235" returned: 0 in 0.405s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074a7c9e-3b55-4181-94a6-e18f9e560dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d93315e-6842-499e-8ed3-6d7e8bf40235', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102d9565-d4aa-47a9-bf6e-536728e7be14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:10 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Volume volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 (0d93315e-6842-499e-8ed3-6d7e8bf40235): created successfully
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102d9565-d4aa-47a9-bf6e-536728e7be14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:10 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (17913bcb-41d4-4f4e-a4d9-efc34a2cfd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:10 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-7fb720cc-ba0d-491e-9519-059d2555b7b7 tempest-VolumesActionsTest-481100502 None] Created volume successfully.
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-0d93315e-6842-499e-8ed3-6d7e8bf40235-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Lock "cinder-0d93315e-6842-499e-8ed3-6d7e8bf40235-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-quobyte-0d93315e-6842-499e-8ed3-6d7e8bf40235" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-0d93315e-6842-499e-8ed3-6d7e8bf40235" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9190af79-ec36-4048-8117-75d20da63b3f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:12 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235
Feb 27 01:32:12 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:12 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235" returned: 0 in 0.463s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:12 devstack sudo[90803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235
Feb 27 01:32:12 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:12 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0d93315e-6842-499e-8ed3-6d7e8bf40235" returned: 0 in 0.406s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-0d93315e-6842-499e-8ed3-6d7e8bf40235" released by "delete_volume" :: held 0.895s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:12 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Created reservations ['0430086f-0b00-4f42-b5f5-5c09abce8a4f', '4c299b2e-1a42-4c01-af87-0d292a86778f', '27a7dff0-5bd5-4450-8d3c-9c9b86404824', 'ab02c6b7-3fe2-47d6-8a03-98bc4b8d0865'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:13 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:13 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (a90f931c-3906-43fc-ba22-37d3b1349627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a55c348-3e7d-4ea5-89fa-2784278912e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a55c348-3e7d-4ea5-89fa-2784278912e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1089530196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc35089-9b60-48d6-9c02-b3d9bbf19bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:13Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804c77ad-63f2-412b-a9e8-690d1decce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804c77ad-63f2-412b-a9e8-690d1decce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2c098b-c9a5-466b-a66b-82c89b283a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2c098b-c9a5-466b-a66b-82c89b283a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc35089-9b60-48d6-9c02-b3d9bbf19bcc', 'volume_name': 'volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245f8ead-561b-415d-a953-0ad7d9474d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245f8ead-561b-415d-a953-0ad7d9474d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77780964-049d-42d3-9eaf-e4260d824d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:13 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Volume edc35089-9b60-48d6-9c02-b3d9bbf19bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc', 'volume_size': 1}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1089530196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc35089-9b60-48d6-9c02-b3d9bbf19bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:13Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Creating volume edc35089-9b60-48d6-9c02-b3d9bbf19bcc {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:13 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:13 devstack sudo[90809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc 1073741824
Feb 27 01:32:13 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:13 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.481s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Deleted volume successfully.
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b619ceae-1f85-413f-bfe3-e64275fa8608 tempest-VolumesActionsTest-300883864 None] Lock "cinder-0d93315e-6842-499e-8ed3-6d7e8bf40235-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:13 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc 1073741824" returned: 0 in 0.496s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:14 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc
Feb 27 01:32:14 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:14 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc" returned: 0 in 0.418s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77780964-049d-42d3-9eaf-e4260d824d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9571a4-6fb3-44e6-9a95-05f713019417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:14 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Volume volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc (edc35089-9b60-48d6-9c02-b3d9bbf19bcc): created successfully
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9571a4-6fb3-44e6-9a95-05f713019417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:14 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (a90f931c-3906-43fc-ba22-37d3b1349627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-10698f93-e7b5-4504-8b34-e262f81603c4 tempest-VolumesActionsTest-481100502 None] Created volume successfully.
Feb 27 01:32:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-edc35089-9b60-48d6-9c02-b3d9bbf19bcc-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Lock "cinder-edc35089-9b60-48d6-9c02-b3d9bbf19bcc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-quobyte-edc35089-9b60-48d6-9c02-b3d9bbf19bcc" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-edc35089-9b60-48d6-9c02-b3d9bbf19bcc" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a921ce-c6ec-471f-9669-6fe9699c1141]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:15 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc
Feb 27 01:32:15 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:16 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:16 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc
Feb 27 01:32:16 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:16 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-edc35089-9b60-48d6-9c02-b3d9bbf19bcc" returned: 0 in 0.385s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-edc35089-9b60-48d6-9c02-b3d9bbf19bcc" released by "delete_volume" :: held 0.859s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Created reservations ['0d186cae-afd8-4f60-8eba-d2ad96627e7b', 'ee0fb409-fada-4940-863e-283767918bc7', '2219d86c-3289-41d6-b7b2-0bce70780725', 'cab10cf1-70a3-4cbd-b539-64fecbdda881'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:16 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:16 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (268fdcf1-0244-4bb9-903e-1fb565978221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc06ca6-a174-4239-a2f2-5b3208b8e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc06ca6-a174-4239-a2f2-5b3208b8e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-656328093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87e688b-bb14-4efb-b83a-cd31df98031a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:17Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e459dd9d-cd9c-489c-9b85-1d33a6504c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e459dd9d-cd9c-489c-9b85-1d33a6504c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c65be-5d27-40df-bd44-1c8660d808d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c65be-5d27-40df-bd44-1c8660d808d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87e688b-bb14-4efb-b83a-cd31df98031a', 'volume_name': 'volume-d87e688b-bb14-4efb-b83a-cd31df98031a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:17 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd0c9b4-e291-42b2-810f-570d2517658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd0c9b4-e291-42b2-810f-570d2517658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282422e-47d2-49cb-ba40-1ce019ffd86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:17 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Volume d87e688b-bb14-4efb-b83a-cd31df98031a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87e688b-bb14-4efb-b83a-cd31df98031a', 'volume_size': 1}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-656328093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87e688b-bb14-4efb-b83a-cd31df98031a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:17Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Creating volume d87e688b-bb14-4efb-b83a-cd31df98031a {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:17 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.481s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Deleted volume successfully.
Feb 27 01:32:17 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a 1073741824
Feb 27 01:32:17 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5b75495-80ea-4cc5-8eca-06aae49ba059 tempest-VolumesActionsTest-300883864 None] Lock "cinder-edc35089-9b60-48d6-9c02-b3d9bbf19bcc-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:17 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a 1073741824" returned: 0 in 0.501s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:17 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a
Feb 27 01:32:17 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:18 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a" returned: 0 in 0.471s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282422e-47d2-49cb-ba40-1ce019ffd86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87e688b-bb14-4efb-b83a-cd31df98031a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb8c3b2-f145-4099-9109-fb7c42c15c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:18 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Volume volume-d87e688b-bb14-4efb-b83a-cd31df98031a (d87e688b-bb14-4efb-b83a-cd31df98031a): created successfully
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb8c3b2-f145-4099-9109-fb7c42c15c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:18 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (268fdcf1-0244-4bb9-903e-1fb565978221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:18 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4feb55c3-5fe3-46ff-a6c4-d5c3e23dbf04 tempest-VolumesActionsTest-481100502 None] Created volume successfully.
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-d87e688b-bb14-4efb-b83a-cd31df98031a-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Lock "cinder-d87e688b-bb14-4efb-b83a-cd31df98031a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Acquiring lock "cinder-quobyte-d87e688b-bb14-4efb-b83a-cd31df98031a" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-d87e688b-bb14-4efb-b83a-cd31df98031a" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e565d7-0c83-4196-8331-1b002e0c7c4b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:19 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a
Feb 27 01:32:19 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:19 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a" returned: 0 in 0.535s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:19 devstack sudo[90842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a
Feb 27 01:32:19 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:20 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-d87e688b-bb14-4efb-b83a-cd31df98031a" returned: 0 in 0.464s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Lock "cinder-quobyte-d87e688b-bb14-4efb-b83a-cd31df98031a" released by "delete_volume" :: held 1.025s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Created reservations ['ee119626-0563-4a30-adfe-c891016fd4c8', 'faefbeb5-240e-4e9a-a0be-32b544c69789', 'df240848-e4cf-4df9-89cd-c4b9f3585d61', 'c620c4ac-5aba-4a1f-a6e8-e2d4e1e6bf9d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:20 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:20 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:20 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.488s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Deleted volume successfully.
Feb 27 01:32:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-342e0182-ab9d-4a02-a20a-be1d070fa6d6 tempest-VolumesActionsTest-300883864 None] Lock "cinder-d87e688b-bb14-4efb-b83a-cd31df98031a-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (dfe80064-4b6f-43f6-a0d9-5552b4e59390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adc20d4-2c57-4b7d-95d9-70a666fe4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adc20d4-2c57-4b7d-95d9-70a666fe4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755311856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326757d8-07b6-4705-9873-a4433155d64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:22Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ea3e32-9bb0-43ec-8588-c48965cf497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ea3e32-9bb0-43ec-8588-c48965cf497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee73e457-8895-4f1b-8606-46312c3de269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee73e457-8895-4f1b-8606-46312c3de269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326757d8-07b6-4705-9873-a4433155d64a', 'volume_name': 'volume-326757d8-07b6-4705-9873-a4433155d64a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4ea79f-529c-4aac-aabc-ac42195fd18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4ea79f-529c-4aac-aabc-ac42195fd18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43778462-3376-416e-9401-101846abb23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:21 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Volume 326757d8-07b6-4705-9873-a4433155d64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326757d8-07b6-4705-9873-a4433155d64a', 'volume_size': 1}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755311856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326757d8-07b6-4705-9873-a4433155d64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d7755a4a54429080fc4fc895d51f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:22Z,use_quota=True,user_id='3c82b062392c44d88c822b3762450403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Creating volume 326757d8-07b6-4705-9873-a4433155d64a {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:21 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:32:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:21 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a 1073741824
Feb 27 01:32:21 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:22 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a 1073741824" returned: 0 in 0.516s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:22 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a
Feb 27 01:32:22 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:23 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a" returned: 0 in 0.442s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43778462-3376-416e-9401-101846abb23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326757d8-07b6-4705-9873-a4433155d64a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3066430f-da42-497e-af76-09e4830b7d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:23 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Volume volume-326757d8-07b6-4705-9873-a4433155d64a (326757d8-07b6-4705-9873-a4433155d64a): created successfully
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3066430f-da42-497e-af76-09e4830b7d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Flow 'volume_create_manager' (dfe80064-4b6f-43f6-a0d9-5552b4e59390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:24 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-bc1faf9b-3d8c-4196-9460-59656d4a9675 tempest-VolumesActionsTest-481100502 None] Created volume successfully.
Feb 27 01:32:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Acquiring lock "cinder-326757d8-07b6-4705-9873-a4433155d64a-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Lock "cinder-326757d8-07b6-4705-9873-a4433155d64a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Acquiring lock "cinder-quobyte-326757d8-07b6-4705-9873-a4433155d64a" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Lock "cinder-quobyte-326757d8-07b6-4705-9873-a4433155d64a" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:25 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c76ec1-bc43-49bc-aedb-7b6ede1ec260]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:25 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a
Feb 27 01:32:25 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:26 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a" returned: 0 in 0.499s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:26 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a
Feb 27 01:32:26 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:26 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-326757d8-07b6-4705-9873-a4433155d64a" returned: 0 in 0.422s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Lock "cinder-quobyte-326757d8-07b6-4705-9873-a4433155d64a" released by "delete_volume" :: held 0.944s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Created reservations ['448cc2c3-cadc-4392-9c9d-61c11e5d47ca', 'db301f21-0caa-476c-876c-c01fafe7483c', 'fa352bf3-fef1-4b5d-b90f-09d160f3dbe3', '78894e26-75a0-40fa-be2e-bd474d7f6f60'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:27 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:27 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:28 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.430s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:28 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Deleted volume successfully.
Feb 27 01:32:29 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-b43688c0-ae48-4dad-ba38-132c71525af8 tempest-VolumesActionsTest-481100502 None] Lock "cinder-326757d8-07b6-4705-9873-a4433155d64a-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:30 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:30 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:31 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.396s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:37 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=42,cinder:UPDATE=72,cinder:INSERT=15,cinder:DELETE=7 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:32:38 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=57,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=17 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Flow 'volume_create_manager' (e5e81b94-817b-48e3-9490-9b34c83ed834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f5a57-016c-469f-a8ba-e81e384e73ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f5a57-016c-469f-a8ba-e81e384e73ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1389314266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e168dbcdaffc4838b1c5df0ae0fc2bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:41Z,use_quota=True,user_id='88980131c4a64338969ff96abc7d6538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b5404b-70df-4f5a-abe1-c39090244709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b5404b-70df-4f5a-abe1-c39090244709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e524fe0e-9340-40ca-9041-f22d51528a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e524fe0e-9340-40ca-9041-f22d51528a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'volume_name': 'volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e65d91-a660-4ca9-9c58-ee0c996abd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e65d91-a660-4ca9-9c58-ee0c996abd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66131f2b-52f4-49e5-baec-6b01b0e6e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:41 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Volume 4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'volume_size': 1}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1389314266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e168dbcdaffc4838b1c5df0ae0fc2bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:41Z,use_quota=True,user_id='88980131c4a64338969ff96abc7d6538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Creating volume 4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:41 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:41 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 1073741824
Feb 27 01:32:41 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:41 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 1073741824" returned: 0 in 0.450s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:41 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:41 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:42 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.387s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66131f2b-52f4-49e5-baec-6b01b0e6e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f0b4b4-862a-4cff-b790-1936df22b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Volume volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 (4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8): created successfully
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f0b4b4-862a-4cff-b790-1936df22b89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Flow 'volume_create_manager' (e5e81b94-817b-48e3-9490-9b34c83ed834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-666f8907-4bfc-44b1-9c64-e4ee9013d0c5 tempest-VolumesCloneTest-1923626787 None] Created volume successfully.
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Flow 'volume_create_manager' (bd70f5bd-25a0-464d-8198-bb31cb4f275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab18bd1-0712-42c2-bbad-55f6870f20c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab18bd1-0712-42c2-bbad-55f6870f20c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1702774668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c65b3-0cb5-49a3-8537-f0e4c59de79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e168dbcdaffc4838b1c5df0ae0fc2bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:43Z,use_quota=True,user_id='88980131c4a64338969ff96abc7d6538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b68b9c-9a48-4aca-89c8-be9d7cc138e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b68b9c-9a48-4aca-89c8-be9d7cc138e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5d1e72-9fd7-458e-9a13-fe0f4222d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5d1e72-9fd7-458e-9a13-fe0f4222d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7d5c65b3-0cb5-49a3-8537-f0e4c59de79e', 'volume_name': 'volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e', 'volume_size': 2, 'source_volid': '4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf9b56e-b3c1-41b2-844c-a9a9c4be805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf9b56e-b3c1-41b2-844c-a9a9c4be805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbaca65d-6fe4-4762-bdcc-c7a703ee4e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Volume 7d5c65b3-0cb5-49a3-8537-f0e4c59de79e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e', 'volume_size': 2, 'source_volid': '4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'source_volstatus': 'available'}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:42 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Cloning volume 4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 to volume 7d5c65b3-0cb5-49a3-8537-f0e4c59de79e
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Creating offline snapshot 5921eab1-8676-49a3-8ddf-42281a001885 of volume 4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bfdd18-41be-4abd-aca8-cda5c6306561]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:42 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:42 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:43 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:43 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 1G
Feb 27 01:32:43 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:43 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 1G" returned: 0 in 0.496s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:43 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885
Feb 27 01:32:43 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:44 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885" returned: 0 in 0.405s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:44 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 is being set with open permissions: ugo+rw
Feb 27 01:32:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:44 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885
Feb 27 01:32:44 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:44 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885" returned: 0 in 0.414s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:44 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info
Feb 27 01:32:44 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:44 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info" returned: 0 in 0.391s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:44 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info is being set with open permissions: ugo+rw
Feb 27 01:32:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:44 devstack sudo[90914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info
Feb 27 01:32:44 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:45 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.info" returned: 0 in 0.382s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Acquiring lock "cinder-quobyte-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] snapshot: 5921eab1-8676-49a3-8ddf-42281a001885, volume: 7d5c65b3-0cb5-49a3-8537-f0e4c59de79e,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb141dfd-65d0-4f06-8a63-6bf234300dbb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:45 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885
Feb 27 01:32:45 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:45 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b027d388-54b8-4dce-bc4d-a698c1be7e21]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:45 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:45 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:46 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:46 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:32:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:46 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e
Feb 27 01:32:46 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:48 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" returned: 0 in 1.900s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d6b1cd-16b5-4c38-bd85-0ff73353f61c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:48 devstack sudo[90975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:48 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:48 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.583s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:48 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:32:48 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Converted 1024.00 MB image at 538.61 MB/s
Feb 27 01:32:48 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e is being set with open permissions: ugo+rw
Feb 27 01:32:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:48 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e
Feb 27 01:32:48 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:49 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" returned: 0 in 0.443s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" released by "_copy_volume_from_snapshot" :: held 3.918s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Acquiring lock "cinder-quobyte-5921eab1-8676-49a3-8ddf-42281a001885" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-5921eab1-8676-49a3-8ddf-42281a001885" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Deleting offline snapshot 5921eab1-8676-49a3-8ddf-42281a001885 of volume 4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] snapshot_file for this snap is: volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f4853-447c-495f-bdc7-60c46b277d3f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:49 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885
Feb 27 01:32:49 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:49 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885" returned: 0 in 0.457s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3d77b1-562d-43d3-8ba5-096cb75e05b1]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:49 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:49 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:50 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:50 devstack sudo[90994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885
Feb 27 01:32:50 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:50 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:50 devstack sudo[90999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885
Feb 27 01:32:50 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:51 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8.5921eab1-8676-49a3-8ddf-42281a001885" returned: 0 in 0.446s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-5921eab1-8676-49a3-8ddf-42281a001885" released by "_delete_snapshot" :: held 1.922s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.712s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbaca65d-6fe4-4762-bdcc-c7a703ee4e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e', 'volume_size': 2, 'source_volid': '4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1f9b88-e47d-487a-aa4c-ec01f1f3c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:53 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Volume volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e (7d5c65b3-0cb5-49a3-8537-f0e4c59de79e): created successfully
Feb 27 01:32:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1f9b88-e47d-487a-aa4c-ec01f1f3c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Flow 'volume_create_manager' (bd70f5bd-25a0-464d-8198-bb31cb4f275b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:54 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e3394d76-5354-4c67-a70e-b89b144ef6af tempest-VolumesCloneTest-1923626787 None] Created volume successfully.
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "cinder-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "cinder-quobyte-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[575937c2-fc9c-4ee5-bd07-6d7334e9d6c2]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:55 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e
Feb 27 01:32:55 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:55 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" returned: 0 in 0.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:56 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e
Feb 27 01:32:56 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:56 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" returned: 0 in 0.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e" released by "delete_volume" :: held 0.934s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Created reservations ['e6d1a1c7-a53a-4e42-a0e0-0fc32035823d', '8a37dfeb-2f0f-458c-98ae-17b2e82ca240', 'f504fe30-f947-4b42-a4d8-7b26685265bf', 'aed9f672-3130-45da-8b40-871ac1593be5'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:56 devstack sudo[91010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:56 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "cinder-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "cinder-quobyte-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7985a65c-67e5-4641-9b99-049b41153c0c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:56 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:56 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:57 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.478s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Deleted volume successfully.
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-220e487b-0e8e-4e75-8311-216ab965e588 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-7d5c65b3-0cb5-49a3-8537-f0e4c59de79e-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:57 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.500s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:57 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8
Feb 27 01:32:57 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:57 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" returned: 0 in 0.399s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-quobyte-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8" released by "delete_volume" :: held 0.925s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:57 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Created reservations ['1e8ea01b-cf10-48f3-84f8-a04da95f6f29', '747877c7-e193-4c4b-957f-c69be70955e3', '638693af-ff41-4de0-b06a-bf2116912302', '1c9199d7-7254-41f4-ac20-fca213b9314b'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:58 devstack sudo[91022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:32:58 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:58 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.393s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:58 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Deleted volume successfully.
Feb 27 01:32:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-da287f7e-792f-43ae-85f8-8c8254109755 tempest-VolumesCloneTest-1923626787 None] Lock "cinder-4bcd7e65-2b7b-4c46-a20c-b496dedf7bb8-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Flow 'volume_create_manager' (051aa9a2-e94f-4527-9e64-0bba429c3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ed5c98-642d-4691-9030-e2a3283c0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ed5c98-642d-4691-9030-e2a3283c0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1302487488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3688ee5d-e6d0-41fe-bdc8-afa0f79723db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4729005a1039493691c3325ec880859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:01Z,use_quota=True,user_id='ecfe6df4f00d42ea9cb383d8d0ef2f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488cff33-6e50-4bbf-b3dd-7829fdf0ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488cff33-6e50-4bbf-b3dd-7829fdf0ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8469436-d7c7-4f96-a3e9-ffd7fb14fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8469436-d7c7-4f96-a3e9-ffd7fb14fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3688ee5d-e6d0-41fe-bdc8-afa0f79723db', 'volume_name': 'volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c54141b-4afa-4f9b-b8ed-dec81f9d875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c54141b-4afa-4f9b-b8ed-dec81f9d875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987dd740-6ab3-4c71-b74d-1bb583123d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:00 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Volume 3688ee5d-e6d0-41fe-bdc8-afa0f79723db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db', 'volume_size': 1}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1302487488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3688ee5d-e6d0-41fe-bdc8-afa0f79723db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4729005a1039493691c3325ec880859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:01Z,use_quota=True,user_id='ecfe6df4f00d42ea9cb383d8d0ef2f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Creating volume 3688ee5d-e6d0-41fe-bdc8-afa0f79723db {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:00 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:33:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:00 devstack sudo[91026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db 1073741824
Feb 27 01:33:00 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:01 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db 1073741824" returned: 0 in 0.455s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:01 devstack sudo[91031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db
Feb 27 01:33:01 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:01 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db" returned: 0 in 0.374s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987dd740-6ab3-4c71-b74d-1bb583123d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783605be-ed01-44f4-98d3-f2c826166965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:01 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Volume volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db (3688ee5d-e6d0-41fe-bdc8-afa0f79723db): created successfully
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783605be-ed01-44f4-98d3-f2c826166965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:01 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Flow 'volume_create_manager' (051aa9a2-e94f-4527-9e64-0bba429c3788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:01 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-59b088d7-e559-47ce-85f0-af0f0c18dc22 tempest-VolumesListTestJSON-821719358 None] Created volume successfully.
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Flow 'volume_create_manager' (96bf017a-daef-4aa8-8f79-5481828cadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7593fa58-c445-47f6-aad1-54a778943bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7593fa58-c445-47f6-aad1-54a778943bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-373542327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c1e0a0-6de2-494e-bfaf-360876a1ee01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4729005a1039493691c3325ec880859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:06Z,use_quota=True,user_id='ecfe6df4f00d42ea9cb383d8d0ef2f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7886a1-c2d3-412c-b62c-74c3f4a94f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7886a1-c2d3-412c-b62c-74c3f4a94f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51ae20a-0bce-41ad-9afa-989ddc9f6a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51ae20a-0bce-41ad-9afa-989ddc9f6a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c1e0a0-6de2-494e-bfaf-360876a1ee01', 'volume_name': 'volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba64fbe-92aa-4fb8-a6a9-2e712382d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba64fbe-92aa-4fb8-a6a9-2e712382d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8b93ea-8060-4350-a755-26f83ce7fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Volume 67c1e0a0-6de2-494e-bfaf-360876a1ee01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01', 'volume_size': 1}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-373542327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c1e0a0-6de2-494e-bfaf-360876a1ee01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4729005a1039493691c3325ec880859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:06Z,use_quota=True,user_id='ecfe6df4f00d42ea9cb383d8d0ef2f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Creating volume 67c1e0a0-6de2-494e-bfaf-360876a1ee01 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:06 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:06 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 1073741824
Feb 27 01:33:06 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:06 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 1073741824" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:06 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01
Feb 27 01:33:06 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:06 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01" returned: 0 in 0.381s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8b93ea-8060-4350-a755-26f83ce7fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c512427-2d14-4a84-857a-28cca68aed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Volume volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 (67c1e0a0-6de2-494e-bfaf-360876a1ee01): created successfully
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c512427-2d14-4a84-857a-28cca68aed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Flow 'volume_create_manager' (96bf017a-daef-4aa8-8f79-5481828cadd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:06 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-107852de-aeb6-468d-a0e0-f9eaf7736c2c tempest-VolumesListTestJSON-821719358 None] Created volume successfully.
Feb 27 01:33:07 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Flow 'volume_create_manager' (d1b7e085-9dd9-462e-8b88-5e019d0dd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac397c8-ef6f-4c34-a6b2-c53ace23334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac397c8-ef6f-4c34-a6b2-c53ace23334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1818886847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e9fe54-28ce-48b6-b4fb-3441f698fd40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4729005a1039493691c3325ec880859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:08Z,use_quota=True,user_id='ecfe6df4f00d42ea9cb383d8d0ef2f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7742110d-409a-4a7d-b8ae-ea03fdfaa019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7742110d-409a-4a7d-b8ae-ea03fdfaa019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881b3625-0ca0-4ca3-b489-4434d694e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881b3625-0ca0-4ca3-b489-4434d694e194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e9fe54-28ce-48b6-b4fb-3441f698fd40', 'volume_name': 'volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431c3af7-8abf-4598-85b7-94668d997d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431c3af7-8abf-4598-85b7-94668d997d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6042e80-e61c-4e27-8408-3ebe3dbb05ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Volume 79e9fe54-28ce-48b6-b4fb-3441f698fd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40', 'volume_size': 1}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1818886847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e9fe54-28ce-48b6-b4fb-3441f698fd40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4729005a1039493691c3325ec880859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:08Z,use_quota=True,user_id='ecfe6df4f00d42ea9cb383d8d0ef2f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Creating volume 79e9fe54-28ce-48b6-b4fb-3441f698fd40 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:08 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:08 devstack sudo[91043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 1073741824
Feb 27 01:33:08 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:08 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 1073741824" returned: 0 in 0.446s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:08 devstack sudo[91048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40
Feb 27 01:33:08 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:08 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40" returned: 0 in 0.371s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6042e80-e61c-4e27-8408-3ebe3dbb05ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5630339c-e366-4237-be51-c11a2e294ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Volume volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 (79e9fe54-28ce-48b6-b4fb-3441f698fd40): created successfully
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5630339c-e366-4237-be51-c11a2e294ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Flow 'volume_create_manager' (d1b7e085-9dd9-462e-8b88-5e019d0dd742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:08 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ba3fee7e-f66d-4d94-9bf5-5ef56ef0114f tempest-VolumesListTestJSON-821719358 None] Created volume successfully.
Feb 27 01:33:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "cinder-79e9fe54-28ce-48b6-b4fb-3441f698fd40-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-79e9fe54-28ce-48b6-b4fb-3441f698fd40-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "cinder-quobyte-79e9fe54-28ce-48b6-b4fb-3441f698fd40" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-quobyte-79e9fe54-28ce-48b6-b4fb-3441f698fd40" acquired by "delete_volume" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c191c-4252-4d86-be51-3be7c89fa376]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:11 devstack sudo[91051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40
Feb 27 01:33:11 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:11 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40" returned: 0 in 0.442s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:11 devstack sudo[91056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40
Feb 27 01:33:11 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:11 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79e9fe54-28ce-48b6-b4fb-3441f698fd40" returned: 0 in 0.370s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-quobyte-79e9fe54-28ce-48b6-b4fb-3441f698fd40" released by "delete_volume" :: held 0.834s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Created reservations ['d1e9bc69-27a3-446d-b943-662d5165312b', '522df0f8-3e14-44b0-8f01-3bc5e31790ac', '919299c4-ce3a-4065-9f3c-21dca839854b', '11fa61b4-78af-42dd-9e57-a369b00958a9'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:11 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:11 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "cinder-67c1e0a0-6de2-494e-bfaf-360876a1ee01-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-67c1e0a0-6de2-494e-bfaf-360876a1ee01-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "cinder-quobyte-67c1e0a0-6de2-494e-bfaf-360876a1ee01" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-quobyte-67c1e0a0-6de2-494e-bfaf-360876a1ee01" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4103b6-dd2a-4b14-81b1-741072c3ba94]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:12 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01
Feb 27 01:33:12 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:12 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.408s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:12 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Deleted volume successfully.
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99889cc5-a749-49db-a825-04c04f33a717 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-79e9fe54-28ce-48b6-b4fb-3441f698fd40-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:12 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01" returned: 0 in 0.442s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:12 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01
Feb 27 01:33:12 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:13 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-67c1e0a0-6de2-494e-bfaf-360876a1ee01" returned: 0 in 0.383s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-quobyte-67c1e0a0-6de2-494e-bfaf-360876a1ee01" released by "delete_volume" :: held 0.847s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Created reservations ['2dcde066-b548-4b50-bf23-a9dec9913216', '0819e426-2e70-4087-9d2f-34a000ea47c9', '928b193b-7a53-4120-a7df-21709e5d3327', '74ea7176-c5ce-4736-8a18-4866f62d2d3b'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:13 devstack sudo[91070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:13 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "cinder-3688ee5d-e6d0-41fe-bdc8-afa0f79723db-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-3688ee5d-e6d0-41fe-bdc8-afa0f79723db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "cinder-quobyte-3688ee5d-e6d0-41fe-bdc8-afa0f79723db" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-quobyte-3688ee5d-e6d0-41fe-bdc8-afa0f79723db" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb58bfe-3e94-4edb-aacd-92cc1d6b9797]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:13 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db
Feb 27 01:33:13 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:13 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.414s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:13 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Deleted volume successfully.
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-fd947dac-b7e8-4d6c-9914-262d82d50a43 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-67c1e0a0-6de2-494e-bfaf-360876a1ee01-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:13 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db" returned: 0 in 0.474s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:13 devstack sudo[91078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db
Feb 27 01:33:13 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:14 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3688ee5d-e6d0-41fe-bdc8-afa0f79723db" returned: 0 in 0.402s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-quobyte-3688ee5d-e6d0-41fe-bdc8-afa0f79723db" released by "delete_volume" :: held 0.899s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Created reservations ['9bfbc873-c8ae-41ca-9b37-f058ca94a659', '243e45ab-68c5-4ff9-940f-c55d4a42b8b1', '7c7f74ae-9242-45e8-8239-2558b50e4f26', '1f9b9267-34ec-4f7a-8e84-74940a27c1ed'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:14 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:14 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:14 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Deleted volume successfully.
Feb 27 01:33:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-27ca3fab-3983-4033-975e-e80503fd1041 tempest-VolumesListTestJSON-821719358 None] Lock "cinder-3688ee5d-e6d0-41fe-bdc8-afa0f79723db-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (06b335cf-f585-4351-80a2-712583491de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a4a817-f69e-42bc-81b2-a7e14d173298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a4a817-f69e-42bc-81b2-a7e14d173298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-649638432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb0d3fc-6a64-4fc1-aea1-5703abdc1835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:22Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbdec19-b906-48d7-aec5-ea2210af77ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbdec19-b906-48d7-aec5-ea2210af77ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1085efa-2285-429e-b9ea-4a212527fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1085efa-2285-429e-b9ea-4a212527fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb0d3fc-6a64-4fc1-aea1-5703abdc1835', 'volume_name': 'volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc47a16-e2e0-4986-bf97-fde8936e368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc47a16-e2e0-4986-bf97-fde8936e368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1d52e-9684-482a-a717-d625eaa91225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:22 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Volume 8cb0d3fc-6a64-4fc1-aea1-5703abdc1835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835', 'volume_size': 1}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-649638432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb0d3fc-6a64-4fc1-aea1-5703abdc1835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:22Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Creating volume 8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:22 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:22 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 1073741824
Feb 27 01:33:22 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:22 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 1073741824" returned: 0 in 0.485s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:22 devstack sudo[91090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835
Feb 27 01:33:22 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:23 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" returned: 0 in 0.384s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1d52e-9684-482a-a717-d625eaa91225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca2f173-6e2a-4359-8199-00b4a2cf6f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:23 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Volume volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 (8cb0d3fc-6a64-4fc1-aea1-5703abdc1835): created successfully
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca2f173-6e2a-4359-8199-00b4a2cf6f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (06b335cf-f585-4351-80a2-712583491de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:23 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ca20a826-fba9-4f45-9214-21d2fdafc96a tempest-VolumesSnapshotTestJSON-685068613 None] Created volume successfully.
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Creating offline snapshot 0cde4978-4274-4e7b-9082-2064a840863b of volume 8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4d9747-935d-4e79-800a-7179e7a6401c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:23 devstack sudo[91093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835
Feb 27 01:33:23 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:23 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" returned: 0 in 0.436s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:23 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b 1G
Feb 27 01:33:23 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:24 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b 1G" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:24 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b
Feb 27 01:33:24 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:24 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:24 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b is being set with open permissions: ugo+rw
Feb 27 01:33:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:24 devstack sudo[91108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b
Feb 27 01:33:24 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:25 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b" returned: 0 in 0.378s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:25 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info
Feb 27 01:33:25 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:25 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info" returned: 0 in 0.389s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:25 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info is being set with open permissions: ugo+rw
Feb 27 01:33:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:25 devstack sudo[91114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info
Feb 27 01:33:25 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:25 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.info" returned: 0 in 0.377s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:25 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-75edea62-f5a2-41a2-8937-0729d6445688 tempest-VolumesSnapshotTestJSON-685068613 None] Create snapshot completed successfully
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-0cde4978-4274-4e7b-9082-2064a840863b-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-0cde4978-4274-4e7b-9082-2064a840863b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-0cde4978-4274-4e7b-9082-2064a840863b" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-0cde4978-4274-4e7b-9082-2064a840863b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Deleting offline snapshot 0cde4978-4274-4e7b-9082-2064a840863b of volume 8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] snapshot_file for this snap is: volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[04efdc1e-a1e8-4fb5-b835-4a35ca82b82f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:26 devstack sudo[91117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b
Feb 27 01:33:26 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:27 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b" returned: 0 in 0.490s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:33:27 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dccc3df-63d4-4642-8560-963eb5933c0f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:27 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835
Feb 27 01:33:27 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:27 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" returned: 0 in 0.440s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:27 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b
Feb 27 01:33:27 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:28 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b" returned: 0 in 0.446s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:28 devstack sudo[91133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b
Feb 27 01:33:28 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:28 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835.0cde4978-4274-4e7b-9082-2064a840863b" returned: 0 in 0.382s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-0cde4978-4274-4e7b-9082-2064a840863b" released by "_delete_snapshot" :: held 1.816s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:28 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" released by "delete_snapshot" :: held 1.827s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:29 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['910dc262-30aa-459f-8211-2fbd965c0489', 'c209b03e-b461-4e6a-859b-2d8d1bca69ef', '7e0ef565-0478-4fd7-8cc3-f1e233b4c319', '79a9b28d-cd98-4e4a-b2a0-a5eb8aec863a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:29 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Delete snapshot completed successfully.
Feb 27 01:33:29 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-91f6f072-f5ec-43e4-a6c7-4842cd943568 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-0cde4978-4274-4e7b-9082-2064a840863b-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:30 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:30 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:31 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.390s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (a328d540-05bd-4be7-a24b-e4b9600184d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04b8e03-b85d-42b0-bdf8-cfcbdda6e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04b8e03-b85d-42b0-bdf8-cfcbdda6e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2003050680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159494d0-fe79-455a-aa05-3f8247230817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:34Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2517a1-e551-4608-af3a-0116ef5c1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2517a1-e551-4608-af3a-0116ef5c1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdcf40b8-e921-4b6e-91be-dae8f632a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdcf40b8-e921-4b6e-91be-dae8f632a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159494d0-fe79-455a-aa05-3f8247230817', 'volume_name': 'volume-159494d0-fe79-455a-aa05-3f8247230817', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad1a0b7-a829-4e51-9a38-04eecf8f5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad1a0b7-a829-4e51-9a38-04eecf8f5a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a7e9b5-f89a-4afe-8aeb-1d7deba6dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:34 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Volume 159494d0-fe79-455a-aa05-3f8247230817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159494d0-fe79-455a-aa05-3f8247230817', 'volume_size': 1}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2003050680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159494d0-fe79-455a-aa05-3f8247230817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:34Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Creating volume 159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:34 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:34 devstack sudo[91141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 1073741824
Feb 27 01:33:34 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:34 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 1073741824" returned: 0 in 0.442s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:34 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:34 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:35 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.387s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a7e9b5-f89a-4afe-8aeb-1d7deba6dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159494d0-fe79-455a-aa05-3f8247230817', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128cd510-481f-48c8-9ca5-37fea0e30a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:35 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Volume volume-159494d0-fe79-455a-aa05-3f8247230817 (159494d0-fe79-455a-aa05-3f8247230817): created successfully
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128cd510-481f-48c8-9ca5-37fea0e30a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (a328d540-05bd-4be7-a24b-e4b9600184d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:35 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-51e5c028-e7c2-4d3f-ad4a-ac4e41a9c061 tempest-VolumesSnapshotTestJSON-685068613 None] Created volume successfully.
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Creating offline snapshot 24060da0-6833-44e6-8886-9391e9106d0a of volume 159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[460be2cb-f05f-47ab-90c6-5956c7ae227a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:35 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:35 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:36 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.470s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:36 devstack sudo[91154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a 1G
Feb 27 01:33:36 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:36 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a 1G" returned: 0 in 0.441s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159494d0-fe79-455a-aa05-3f8247230817 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:36 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159494d0-fe79-455a-aa05-3f8247230817 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a
Feb 27 01:33:36 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:37 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159494d0-fe79-455a-aa05-3f8247230817 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a" returned: 0 in 0.405s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:37 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a is being set with open permissions: ugo+rw
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:37 devstack sudo[91164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a
Feb 27 01:33:37 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:37 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a" returned: 0 in 0.366s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:UPDATE=71,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=6 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:37 devstack sudo[91167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info
Feb 27 01:33:37 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:37 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info" returned: 0 in 0.381s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:37 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info is being set with open permissions: ugo+rw
Feb 27 01:33:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:37 devstack sudo[91171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info
Feb 27 01:33:37 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:38 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.info" returned: 0 in 0.374s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:38 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c9c10f51-ab03-4a8f-a8d0-9266196937e5 tempest-VolumesSnapshotTestJSON-685068613 None] Create snapshot completed successfully
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=69,cinder:UPDATE=72,cinder:DELETE=7,cinder:INSERT=18 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (cf0fbda3-d424-42f0-bae9-f6583d3be039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f704579-19c8-417d-ae06-6779d033cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f704579-19c8-417d-ae06-6779d033cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-731378549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327a8f37-4d51-4611-96d3-031206c6212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=24060da0-6833-44e6-8886-9391e9106d0a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:39Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dd108b-fe6f-4fc3-8742-60ded2f5ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dd108b-fe6f-4fc3-8742-60ded2f5ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2ff288-3b93-43f8-8013-596f627458c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2ff288-3b93-43f8-8013-596f627458c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '327a8f37-4d51-4611-96d3-031206c6212b', 'volume_name': 'volume-327a8f37-4d51-4611-96d3-031206c6212b', 'volume_size': 2, 'snapshot_id': '24060da0-6833-44e6-8886-9391e9106d0a'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588fbf1b-8c87-49f9-b083-74274a465e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588fbf1b-8c87-49f9-b083-74274a465e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2b75f1-ba27-4bdd-ab0e-37d7a8fcb92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:39 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Volume 327a8f37-4d51-4611-96d3-031206c6212b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-327a8f37-4d51-4611-96d3-031206c6212b', 'volume_size': 2, 'snapshot_id': '24060da0-6833-44e6-8886-9391e9106d0a'}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-24060da0-6833-44e6-8886-9391e9106d0a-327a8f37-4d51-4611-96d3-031206c6212b" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-24060da0-6833-44e6-8886-9391e9106d0a-327a8f37-4d51-4611-96d3-031206c6212b" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Creating volume 327a8f37-4d51-4611-96d3-031206c6212b from snapshot 24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-327a8f37-4d51-4611-96d3-031206c6212b" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-327a8f37-4d51-4611-96d3-031206c6212b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] snapshot: 24060da0-6833-44e6-8886-9391e9106d0a, volume: 327a8f37-4d51-4611-96d3-031206c6212b,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[877dfc74-7d92-48c0-be7b-4707c9512564]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:39 devstack sudo[91174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a
Feb 27 01:33:39 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:39 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159494d0-fe79-455a-aa05-3f8247230817(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd44701-56f5-4517-ac03-9bbe41e70ffa]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:39 devstack sudo[91179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:39 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:40 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:40 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:33:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:40 devstack sudo[91184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b
Feb 27 01:33:40 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:41 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b" returned: 0 in 1.830s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:41 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc4e50-96c5-46f4-9012-e2b380873b6e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:42 devstack sudo[91202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:42 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:42 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.593s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:33:42 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Converted 1024.00 MB image at 559.07 MB/s
Feb 27 01:33:42 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b is being set with open permissions: ugo+rw
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:42 devstack sudo[91207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b
Feb 27 01:33:42 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:42 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b" returned: 0 in 0.375s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-327a8f37-4d51-4611-96d3-031206c6212b" released by "_copy_volume_from_snapshot" :: held 3.751s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-24060da0-6833-44e6-8886-9391e9106d0a-327a8f37-4d51-4611-96d3-031206c6212b" released by "_create_volume_from_snapshot" :: held 3.768s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.775s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2b75f1-ba27-4bdd-ab0e-37d7a8fcb92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327a8f37-4d51-4611-96d3-031206c6212b', 'volume_size': 2, 'snapshot_id': '24060da0-6833-44e6-8886-9391e9106d0a'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a02e86-bc44-475c-9dfc-5aa5d6a93947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Volume volume-327a8f37-4d51-4611-96d3-031206c6212b (327a8f37-4d51-4611-96d3-031206c6212b): created successfully
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a02e86-bc44-475c-9dfc-5aa5d6a93947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (cf0fbda3-d424-42f0-bae9-f6583d3be039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4241bb86-9f0c-4dc4-b77a-70033864506b tempest-VolumesSnapshotTestJSON-685068613 None] Created volume successfully.
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-327a8f37-4d51-4611-96d3-031206c6212b-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-327a8f37-4d51-4611-96d3-031206c6212b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-327a8f37-4d51-4611-96d3-031206c6212b" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-327a8f37-4d51-4611-96d3-031206c6212b" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d854de1-2467-466b-b7fb-ef16204cf97f]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:43 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b
Feb 27 01:33:43 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:43 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:43 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b
Feb 27 01:33:43 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:44 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-327a8f37-4d51-4611-96d3-031206c6212b" returned: 0 in 0.401s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-327a8f37-4d51-4611-96d3-031206c6212b" released by "delete_volume" :: held 0.887s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['52a85caf-97d8-4fb5-81a8-6a44c4cd9586', 'c420d211-d524-46ed-9c1e-78b9f140f33f', '494c6754-7baa-410a-b437-84daa9dc5109', '88fafc7f-fa7a-4b53-9f82-7452a7c8dbea'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:44 devstack sudo[91218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:44 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-24060da0-6833-44e6-8886-9391e9106d0a-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-24060da0-6833-44e6-8886-9391e9106d0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-159494d0-fe79-455a-aa05-3f8247230817" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-159494d0-fe79-455a-aa05-3f8247230817" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-24060da0-6833-44e6-8886-9391e9106d0a" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-24060da0-6833-44e6-8886-9391e9106d0a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Deleting offline snapshot 24060da0-6833-44e6-8886-9391e9106d0a of volume 159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] snapshot_file for this snap is: volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[30936833-daee-4eab-937e-1d5a7cb315f4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:44 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a
Feb 27 01:33:44 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:44 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.432s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:44 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Deleted volume successfully.
Feb 27 01:33:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-73d081fe-29ca-44db-a45c-2c29c6e10e57 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-327a8f37-4d51-4611-96d3-031206c6212b-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:45 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a" returned: 0 in 0.461s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159494d0-fe79-455a-aa05-3f8247230817(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[3508bf67-6683-47ba-9d99-e608b0a54a9c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:45 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:45 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:45 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:45 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a
Feb 27 01:33:45 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:45 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a" returned: 0 in 0.430s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:46 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a
Feb 27 01:33:46 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:46 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817.24060da0-6833-44e6-8886-9391e9106d0a" returned: 0 in 0.398s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-24060da0-6833-44e6-8886-9391e9106d0a" released by "_delete_snapshot" :: held 1.808s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-159494d0-fe79-455a-aa05-3f8247230817" released by "delete_snapshot" :: held 1.819s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['d8786c04-ef31-4494-9298-622a5dfa5ff5', 'bf964024-1a28-40e2-ab06-b1bab72bb77e', '112d10fd-2b7c-4f1b-9e97-7b0113e12d9e', '67fab519-0874-41c6-b062-a18be6bfe81d'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Delete snapshot completed successfully.
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4f8b6025-21c4-4c49-afda-c58c12954400 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-24060da0-6833-44e6-8886-9391e9106d0a-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-159494d0-fe79-455a-aa05-3f8247230817-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-159494d0-fe79-455a-aa05-3f8247230817-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-159494d0-fe79-455a-aa05-3f8247230817" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-159494d0-fe79-455a-aa05-3f8247230817" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6ce900-1236-4d43-8a92-3d765de703d2]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:46 devstack sudo[91273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:46 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:47 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:47 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817
Feb 27 01:33:47 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:47 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-159494d0-fe79-455a-aa05-3f8247230817" returned: 0 in 0.395s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-159494d0-fe79-455a-aa05-3f8247230817" released by "delete_volume" :: held 0.876s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['343812cb-5fe0-476d-89a4-cf2adb354517', '3212a278-9949-4f0d-ba47-4b96e2ac2159', 'd740654d-1b2d-4f3a-8570-a08f319c775b', '308b9c2d-f532-4bb0-8541-23ff50c6637c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:47 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:47 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:48 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.420s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (a9b0dd12-7557-4e47-836b-0292dd7d363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4060c16-9f5c-4af5-83b7-e3f95e44c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Deleted volume successfully.
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4060c16-9f5c-4af5-83b7-e3f95e44c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-549494881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99d0674-97c3-4e2d-8095-a6c785387444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:48Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e47f13-2cf9-40b2-a999-7fc61a3ab8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e47f13-2cf9-40b2-a999-7fc61a3ab8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669281bb-7c28-415d-b29b-cdf0e68981c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669281bb-7c28-415d-b29b-cdf0e68981c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99d0674-97c3-4e2d-8095-a6c785387444', 'volume_name': 'volume-e99d0674-97c3-4e2d-8095-a6c785387444', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1af872-92b8-45ac-bd51-e5b3a254b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1af872-92b8-45ac-bd51-e5b3a254b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1025c9-892e-4c98-a7ae-ef0b476ff5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:48 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Volume e99d0674-97c3-4e2d-8095-a6c785387444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99d0674-97c3-4e2d-8095-a6c785387444', 'volume_size': 1}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-549494881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99d0674-97c3-4e2d-8095-a6c785387444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:48Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Creating volume e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:48 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-cf533f88-e48c-454a-be4a-ec52628385ad tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-159494d0-fe79-455a-aa05-3f8247230817-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:48 devstack sudo[91285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 1073741824
Feb 27 01:33:48 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:48 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 1073741824" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:48 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:33:48 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:49 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.421s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1025c9-892e-4c98-a7ae-ef0b476ff5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99d0674-97c3-4e2d-8095-a6c785387444', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6ce628-7184-479d-92cd-38394730caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:49 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Volume volume-e99d0674-97c3-4e2d-8095-a6c785387444 (e99d0674-97c3-4e2d-8095-a6c785387444): created successfully
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6ce628-7184-479d-92cd-38394730caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (a9b0dd12-7557-4e47-836b-0292dd7d363e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:49 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-63ee3e2b-ee45-4eda-a210-fac89ee391bd tempest-VolumesSnapshotTestJSON-685068613 None] Created volume successfully.
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Creating offline snapshot baf5ec03-a13d-43c9-9684-4db9f2c00aaa of volume e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[01507040-d592-4ac2-8540-1164a721a717]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:50 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:33:50 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:50 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.476s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:50 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa 1G
Feb 27 01:33:50 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:51 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa 1G" returned: 0 in 0.529s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99d0674-97c3-4e2d-8095-a6c785387444 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:51 devstack sudo[91304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99d0674-97c3-4e2d-8095-a6c785387444 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa
Feb 27 01:33:51 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:51 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99d0674-97c3-4e2d-8095-a6c785387444 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa" returned: 0 in 0.419s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:51 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa is being set with open permissions: ugo+rw
Feb 27 01:33:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:51 devstack sudo[91309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa
Feb 27 01:33:51 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:52 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa" returned: 0 in 0.404s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:52 devstack sudo[91312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info
Feb 27 01:33:52 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:52 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info" returned: 0 in 0.420s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:52 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info is being set with open permissions: ugo+rw
Feb 27 01:33:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:52 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info
Feb 27 01:33:52 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:53 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.info" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:53 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3df2d129-64a3-4ccb-92b9-de2823f47fd3 tempest-VolumesSnapshotTestJSON-685068613 None] Create snapshot completed successfully
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (26685826-5a96-4954-8081-be417d74a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff34a19-9f8b-4f9f-9673-a52ac50552b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff34a19-9f8b-4f9f-9673-a52ac50552b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-803537699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f99a70-ee76-4c43-882f-3267a4c79197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be379b8d3c014c828cacb451438876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=baf5ec03-a13d-43c9-9684-4db9f2c00aaa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:33:54Z,use_quota=True,user_id='c0f62eb5689b4776a26c88b9facca3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8bbfb4-fa6d-4079-b743-e0b80bd68e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8bbfb4-fa6d-4079-b743-e0b80bd68e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af537f56-91e9-4ffc-8af1-7bdcbb0d5211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af537f56-91e9-4ffc-8af1-7bdcbb0d5211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79f99a70-ee76-4c43-882f-3267a4c79197', 'volume_name': 'volume-79f99a70-ee76-4c43-882f-3267a4c79197', 'volume_size': 1, 'snapshot_id': 'baf5ec03-a13d-43c9-9684-4db9f2c00aaa'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8286e5d3-5143-4d67-8860-81b97cae8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8286e5d3-5143-4d67-8860-81b97cae8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fa3d8d-a8fe-493f-91b7-bc66e1dcd5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:53 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Volume 79f99a70-ee76-4c43-882f-3267a4c79197: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79f99a70-ee76-4c43-882f-3267a4c79197', 'volume_size': 1, 'snapshot_id': 'baf5ec03-a13d-43c9-9684-4db9f2c00aaa'}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-baf5ec03-a13d-43c9-9684-4db9f2c00aaa-79f99a70-ee76-4c43-882f-3267a4c79197" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-baf5ec03-a13d-43c9-9684-4db9f2c00aaa-79f99a70-ee76-4c43-882f-3267a4c79197" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Creating volume 79f99a70-ee76-4c43-882f-3267a4c79197 from snapshot baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-79f99a70-ee76-4c43-882f-3267a4c79197" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-79f99a70-ee76-4c43-882f-3267a4c79197" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] snapshot: baf5ec03-a13d-43c9-9684-4db9f2c00aaa, volume: 79f99a70-ee76-4c43-882f-3267a4c79197,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f5a66-fc85-4369-b543-3d3dc2f7d982]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:53 devstack sudo[91318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa
Feb 27 01:33:53 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:54 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa" returned: 0 in 0.474s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e99d0674-97c3-4e2d-8095-a6c785387444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e012c0-8c18-4b42-8ab3-5f4b71a90f63]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:54 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:33:54 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:54 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:33:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:54 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197
Feb 27 01:33:54 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:56 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197" returned: 0 in 1.897s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16ca21-4f70-49dc-b744-3e8beddfeb8c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:56 devstack sudo[91340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:33:56 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:57 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.587s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:33:57 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Converted 1024.00 MB image at 539.44 MB/s
Feb 27 01:33:57 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 is being set with open permissions: ugo+rw
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:57 devstack sudo[91345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197
Feb 27 01:33:57 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:57 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-79f99a70-ee76-4c43-882f-3267a4c79197" released by "_copy_volume_from_snapshot" :: held 3.901s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-baf5ec03-a13d-43c9-9684-4db9f2c00aaa-79f99a70-ee76-4c43-882f-3267a4c79197" released by "_create_volume_from_snapshot" :: held 3.916s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.925s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fa3d8d-a8fe-493f-91b7-bc66e1dcd5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f99a70-ee76-4c43-882f-3267a4c79197', 'volume_size': 1, 'snapshot_id': 'baf5ec03-a13d-43c9-9684-4db9f2c00aaa'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26df1100-227f-4b22-bc20-885636ccd9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:33:57 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Volume volume-79f99a70-ee76-4c43-882f-3267a4c79197 (79f99a70-ee76-4c43-882f-3267a4c79197): created successfully
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26df1100-227f-4b22-bc20-885636ccd9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:33:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Flow 'volume_create_manager' (26685826-5a96-4954-8081-be417d74a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:33:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-44a472eb-3570-4583-bab1-8965f75ad6ae tempest-VolumesSnapshotTestJSON-685068613 None] Created volume successfully.
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-79f99a70-ee76-4c43-882f-3267a4c79197-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-79f99a70-ee76-4c43-882f-3267a4c79197-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-79f99a70-ee76-4c43-882f-3267a4c79197" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-79f99a70-ee76-4c43-882f-3267a4c79197" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95a5e1-3902-458b-8372-ee731169474b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:58 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197
Feb 27 01:33:58 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:58 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:58 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197
Feb 27 01:33:58 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:58 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79f99a70-ee76-4c43-882f-3267a4c79197" returned: 0 in 0.407s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-79f99a70-ee76-4c43-882f-3267a4c79197" released by "delete_volume" :: held 0.887s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['b4eaa5fc-d4d5-471f-9dd2-9decfd1c38d9', '482a8a84-5e92-4d80-83c2-f7730acb09b5', 'd09a1a23-f72e-4ed6-ab0d-a49c62d5c236', 'f8eec384-6c46-4fbf-b64a-3bcdd33a8397'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:59 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:33:59 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-baf5ec03-a13d-43c9-9684-4db9f2c00aaa-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-baf5ec03-a13d-43c9-9684-4db9f2c00aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-e99d0674-97c3-4e2d-8095-a6c785387444" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-e99d0674-97c3-4e2d-8095-a6c785387444" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-baf5ec03-a13d-43c9-9684-4db9f2c00aaa" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-baf5ec03-a13d-43c9-9684-4db9f2c00aaa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Deleting offline snapshot baf5ec03-a13d-43c9-9684-4db9f2c00aaa of volume e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] snapshot_file for this snap is: volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f9bbc5-92d2-4d5a-a56f-0b2741b6ae7d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:59 devstack sudo[91359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa
Feb 27 01:33:59 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:33:59 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.418s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:33:59 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Deleted volume successfully.
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4d71304e-e8ba-462c-81c1-ac9dbbd71366 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-79f99a70-ee76-4c43-882f-3267a4c79197-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:33:59 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa" returned: 0 in 0.462s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e99d0674-97c3-4e2d-8095-a6c785387444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f883b-544d-4935-aa4e-41be22de94c2]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:33:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:33:59 devstack sudo[91366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:33:59 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:00 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.463s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:00 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa
Feb 27 01:34:00 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:00 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa" returned: 0 in 0.417s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:00 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa
Feb 27 01:34:00 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:01 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444.baf5ec03-a13d-43c9-9684-4db9f2c00aaa" returned: 0 in 0.391s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-baf5ec03-a13d-43c9-9684-4db9f2c00aaa" released by "_delete_snapshot" :: held 1.789s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-e99d0674-97c3-4e2d-8095-a6c785387444" released by "delete_snapshot" :: held 1.800s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['a85276ee-638a-4e8f-b478-c023ebeb3536', '6bb60ea6-e788-4db9-a347-a5442c11a6c8', '6be92d99-4000-4c4d-85fc-73eff4b52e62', 'e5914636-3663-48ce-a37e-6847edc809e6'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:01 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Delete snapshot completed successfully.
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5ca55ce2-b981-4603-b724-20cfd399fcc4 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-baf5ec03-a13d-43c9-9684-4db9f2c00aaa-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-e99d0674-97c3-4e2d-8095-a6c785387444-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-e99d0674-97c3-4e2d-8095-a6c785387444-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-e99d0674-97c3-4e2d-8095-a6c785387444" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-e99d0674-97c3-4e2d-8095-a6c785387444" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[1933df5c-ebbf-4ca5-8553-afae1a747654]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:01 devstack sudo[91379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:34:01 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:01 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.482s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:01 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444
Feb 27 01:34:01 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:02 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e99d0674-97c3-4e2d-8095-a6c785387444" returned: 0 in 0.403s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-e99d0674-97c3-4e2d-8095-a6c785387444" released by "delete_volume" :: held 0.913s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['8f64369c-9b78-4cf7-83df-beb454cc13a8', 'ce4ec714-da75-4b4c-8ae0-29e7d3b94dc7', 'd5d898d5-773a-4c45-ab76-9070c9e0ee01', 'd43ca96e-8529-4923-b6db-5b0685c7de9b'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:02 devstack sudo[91387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:02 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "cinder-quobyte-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c14bc1-4ab8-49ac-ab92-9eadda3cb492]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:02 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835
Feb 27 01:34:02 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:02 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.408s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:02 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Deleted volume successfully.
Feb 27 01:34:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e61e7cec-f5e6-4247-8a2f-7d169eed6718 tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-e99d0674-97c3-4e2d-8095-a6c785387444-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:03 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" returned: 0 in 0.496s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:03 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835
Feb 27 01:34:03 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:03 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" returned: 0 in 0.391s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-quobyte-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835" released by "delete_volume" :: held 0.913s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Created reservations ['e4a0bc4f-e463-4dd6-9d5a-51f9f6e202c1', '547b5c78-476b-430f-92bb-63903317e9d9', '1fee30d0-fec9-4d35-9bbf-c2d1201f666b', 'fd4a8a14-4d8d-4268-89d5-a4b83d90cff2'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:03 devstack sudo[91398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:03 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:04 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.425s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:04 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:04 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Deleted volume successfully.
Feb 27 01:34:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a0b71235-ad11-4d46-80f9-f0356c2e8e8a tempest-VolumesSnapshotTestJSON-685068613 None] Lock "cinder-8cb0d3fc-6a64-4fc1-aea1-5703abdc1835-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Flow 'volume_create_manager' (12c4227a-c15b-4cbc-a418-26d114cb60ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca776c1d-8abd-4f20-92ab-419fe0be2ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca776c1d-8abd-4f20-92ab-419fe0be2ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3b3c8589f74bf0ac9830021db45be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:07Z,use_quota=True,user_id='2e744294ddf34eee961d6c16aadee2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718c60a5-cf68-4504-b326-8c942117847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718c60a5-cf68-4504-b326-8c942117847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab43a2f-ce7c-4e40-986f-418bb393a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab43a2f-ce7c-4e40-986f-418bb393a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140', 'volume_name': 'volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbcb0ef-27aa-4b04-ad44-9e61ccf70d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbcb0ef-27aa-4b04-ad44-9e61ccf70d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ddcabd-ae32-493e-9be9-099470216cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:07 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Volume 9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140', 'volume_size': 1}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3b3c8589f74bf0ac9830021db45be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:07Z,use_quota=True,user_id='2e744294ddf34eee961d6c16aadee2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Creating volume 9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:07 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:07 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 1073741824
Feb 27 01:34:07 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:07 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 1073741824" returned: 0 in 0.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:07 devstack sudo[91409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140
Feb 27 01:34:07 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:07 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140" returned: 0 in 0.387s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ddcabd-ae32-493e-9be9-099470216cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af791caa-7ec9-423b-89d3-627ae34afbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:07 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Volume volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 (9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140): created successfully
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af791caa-7ec9-423b-89d3-627ae34afbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:07 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Flow 'volume_create_manager' (12c4227a-c15b-4cbc-a418-26d114cb60ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f409c4c0-9b66-4a1a-aa15-50644b7aaa9a tempest-CinderUnicodeTest-1610987852 None] Created volume successfully.
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Flow 'volume_create_manager' (b89123d6-8ffa-4f4b-807f-dee6bf375174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210d0fa2-fbae-4b2e-8dd7-bc0766619ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210d0fa2-fbae-4b2e-8dd7-bc0766619ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1534031325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3b3c8589f74bf0ac9830021db45be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:08Z,use_quota=True,user_id='2e744294ddf34eee961d6c16aadee2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09769132-5e4b-4c40-98e5-f24b4a068465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09769132-5e4b-4c40-98e5-f24b4a068465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb05a5d-4371-41b4-8f34-d7db8174598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb05a5d-4371-41b4-8f34-d7db8174598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e', 'volume_name': 'volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497e48ab-bd0b-449d-a66d-5af9c74660ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497e48ab-bd0b-449d-a66d-5af9c74660ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca742ac-af06-4c9b-893b-5cb949f22620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:08 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Volume c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e', 'volume_size': 1}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1534031325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3b3c8589f74bf0ac9830021db45be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:08Z,use_quota=True,user_id='2e744294ddf34eee961d6c16aadee2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Creating volume c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:08 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:08 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e 1073741824
Feb 27 01:34:08 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:08 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e 1073741824" returned: 0 in 0.454s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:08 devstack sudo[91418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e
Feb 27 01:34:08 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:09 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" returned: 0 in 0.386s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca742ac-af06-4c9b-893b-5cb949f22620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05b77b1-cbfa-48f0-b0ec-27fc66d19148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:09 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Volume volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e (c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e): created successfully
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05b77b1-cbfa-48f0-b0ec-27fc66d19148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Flow 'volume_create_manager' (b89123d6-8ffa-4f4b-807f-dee6bf375174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:09 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b29eb7f0-1ace-4f8c-bed5-c1499fa3380e tempest-CinderUnicodeTest-1610987852 None] Created volume successfully.
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Creating offline snapshot 6f69cac8-0518-4a93-b24c-81aba2575de1 of volume c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44e28a-fa7b-4797-9ecb-9e540de480b4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:09 devstack sudo[91421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e
Feb 27 01:34:09 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:10 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" returned: 0 in 0.461s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:10 devstack sudo[91426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 1G
Feb 27 01:34:10 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:10 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 1G" returned: 0 in 0.444s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:10 devstack sudo[91431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1
Feb 27 01:34:10 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:10 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1" returned: 0 in 0.395s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:10 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 is being set with open permissions: ugo+rw
Feb 27 01:34:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:10 devstack sudo[91436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1
Feb 27 01:34:10 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:11 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1" returned: 0 in 0.400s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:11 devstack sudo[91439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info
Feb 27 01:34:11 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:11 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info" returned: 0 in 0.382s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:11 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info is being set with open permissions: ugo+rw
Feb 27 01:34:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:11 devstack sudo[91442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info
Feb 27 01:34:11 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:12 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.info" returned: 0 in 0.388s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:12 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9a37a5ac-73c7-453f-bd9c-f6cd7f1b06df tempest-CinderUnicodeTest-1610987852 None] Create snapshot completed successfully
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-6f69cac8-0518-4a93-b24c-81aba2575de1-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-6f69cac8-0518-4a93-b24c-81aba2575de1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-quobyte-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-quobyte-6f69cac8-0518-4a93-b24c-81aba2575de1" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-6f69cac8-0518-4a93-b24c-81aba2575de1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Deleting offline snapshot 6f69cac8-0518-4a93-b24c-81aba2575de1 of volume c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] snapshot_file for this snap is: volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04d2b0-38ff-48e4-b6a3-99ea1e0c4c92]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:12 devstack sudo[91445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1
Feb 27 01:34:12 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:13 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1" returned: 0 in 0.473s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:34:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd6adf-1806-484a-9a60-1b931d2987ef]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:13 devstack sudo[91450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e
Feb 27 01:34:13 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:13 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" returned: 0 in 0.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:13 devstack sudo[91455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1
Feb 27 01:34:13 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:14 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1" returned: 0 in 0.432s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:14 devstack sudo[91460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1
Feb 27 01:34:14 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:14 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e.6f69cac8-0518-4a93-b24c-81aba2575de1" returned: 0 in 0.393s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-6f69cac8-0518-4a93-b24c-81aba2575de1" released by "_delete_snapshot" :: held 1.795s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" released by "delete_snapshot" :: held 1.805s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Created reservations ['f7e30dcc-26fa-4050-a6e8-c516e0534c05', 'db38ab51-ac6b-4bec-9e46-6283102c17e4', 'eed84dc4-f91c-41b0-85a1-243161a80e73', '0ec41a99-b0cd-4717-ab8a-f2905fc5cf5a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:14 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Delete snapshot completed successfully.
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8b6adfe2-be61-436e-bd6a-9b4dec59b371 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-6f69cac8-0518-4a93-b24c-81aba2575de1-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-quobyte-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a2c730-30b4-47e2-9eb2-9754299ae62e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:14 devstack sudo[91463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e
Feb 27 01:34:14 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:15 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" returned: 0 in 0.450s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:15 devstack sudo[91468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e
Feb 27 01:34:15 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:15 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" returned: 0 in 0.385s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e" released by "delete_volume" :: held 0.860s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Created reservations ['a3dc4195-d1f5-4613-8d9d-b39382a2b211', '1305245a-70a6-46d2-8afe-13df3712c6c6', 'e5460d90-aa19-4888-8a7c-91316a7b977d', '7172a5bb-d95c-4c75-af53-de2cbacc9ff1'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:15 devstack sudo[91471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:15 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "cinder-quobyte-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad29c1-004d-4aac-9ca7-7f08b13a83df]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:16 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140
Feb 27 01:34:16 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:16 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:16 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Deleted volume successfully.
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-8831ba85-844b-49ed-a147-c12404aa6231 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-c4d5b1ba-9af5-4e63-9b0f-1e7c84b52d5e-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:16 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140" returned: 0 in 0.443s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:16 devstack sudo[91479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140
Feb 27 01:34:16 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:16 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140" returned: 0 in 0.382s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-quobyte-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140" released by "delete_volume" :: held 0.850s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Created reservations ['5c6c4419-3b83-40c1-9f16-11b668edbf90', 'c2b0d097-4837-4111-a641-6ad6d8919587', 'dd4f107b-6448-4c17-a95c-3c5b0c1f090d', 'c8c8a737-0a03-4e7a-99ac-4c8d5156fc23'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:16 devstack sudo[91483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:16 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:17 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.416s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:17 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Deleted volume successfully.
Feb 27 01:34:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-9d64e363-c76b-40ed-95cc-4156bfec2328 tempest-CinderUnicodeTest-1610987852 None] Lock "cinder-9f5dfa3a-1a39-47dc-8e8e-39a5d9a0b140-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (64083ec6-9150-49a0-b0ea-2cf29ae64c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e8a040-f9d4-4594-b7be-899b7ccebae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e8a040-f9d4-4594-b7be-899b7ccebae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-987695524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223ad8e-cff4-4df9-9e37-82983c1629e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:25Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8f860a-4f51-4d46-9b4b-666ccf332c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8f860a-4f51-4d46-9b4b-666ccf332c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda9c87e-c217-4c49-becf-1afa121b58a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda9c87e-c217-4c49-becf-1afa121b58a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3223ad8e-cff4-4df9-9e37-82983c1629e4', 'volume_name': 'volume-3223ad8e-cff4-4df9-9e37-82983c1629e4', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d577d9-5212-4e89-a20f-949251f35d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d577d9-5212-4e89-a20f-949251f35d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9304c8ab-a3ea-46df-a34c-5a194c95223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume 3223ad8e-cff4-4df9-9e37-82983c1629e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3223ad8e-cff4-4df9-9e37-82983c1629e4', 'volume_size': 1}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-987695524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223ad8e-cff4-4df9-9e37-82983c1629e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:25Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating volume 3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:25 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:25 devstack sudo[91528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 1073741824
Feb 27 01:34:25 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (71432961-f54d-42ce-8002-837a3b0cd94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d209e65-972e-4378-a14e-2f553a07fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (c1a16408-a9a0-4615-8f87-23c2afcd4dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644e682d-409d-4c0a-9490-48be18b2c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d209e65-972e-4378-a14e-2f553a07fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1264710150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df68bb90-e3d7-4f67-9097-07dc551c41bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5189582c1f3e4cdca94c42e3372bf561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:25Z,use_quota=True,user_id='e3a8f7bc990743a18c4e9e4b48fe7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734cfa9-2458-499b-b6ce-4dd4795c80f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734cfa9-2458-499b-b6ce-4dd4795c80f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c5a150-6bf8-4c2f-bdd3-444178efb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c5a150-6bf8-4c2f-bdd3-444178efb52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df68bb90-e3d7-4f67-9097-07dc551c41bd', 'volume_name': 'volume-df68bb90-e3d7-4f67-9097-07dc551c41bd', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60a752a-5286-41c2-8e95-99c07695c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60a752a-5286-41c2-8e95-99c07695c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73580f6d-a85c-45c1-8c2f-45c07624853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Volume df68bb90-e3d7-4f67-9097-07dc551c41bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df68bb90-e3d7-4f67-9097-07dc551c41bd', 'volume_size': 1}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644e682d-409d-4c0a-9490-48be18b2c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319511571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ce4342-2b5e-4b4a-8d8d-5437678fd65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a9238-9d6b-40e6-ade4-500e4e49f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a9238-9d6b-40e6-ade4-500e4e49f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae48930-e2c0-4574-be9d-d01035eab48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae48930-e2c0-4574-be9d-d01035eab48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ce4342-2b5e-4b4a-8d8d-5437678fd65e', 'volume_name': 'volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e72c5b8-5a40-42e3-9713-617aa06fbebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e72c5b8-5a40-42e3-9713-617aa06fbebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61d1c29-730c-49af-872b-2bf131728462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Volume 63ce4342-2b5e-4b4a-8d8d-5437678fd65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e', 'volume_size': 1}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (04d141bb-57f7-45fd-8fc8-cb1cfc0a5188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed638ac2-6fd6-4d56-968e-56e4c04a7d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed638ac2-6fd6-4d56-968e-56e4c04a7d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-946724721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46df6456-a55a-4cdd-89e5-e2f0748f5a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acbc24d-c38b-42e8-b931-24a7c1abb350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acbc24d-c38b-42e8-b931-24a7c1abb350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc131ece-65db-4e83-bcf9-4e3fc510bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc131ece-65db-4e83-bcf9-4e3fc510bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46df6456-a55a-4cdd-89e5-e2f0748f5a32', 'volume_name': 'volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8e4490-92d2-4fbc-a20c-932f8f2764b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8e4490-92d2-4fbc-a20c-932f8f2764b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14dfae-e553-40e3-a075-a6a6ff8c360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:25 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Volume 46df6456-a55a-4cdd-89e5-e2f0748f5a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32', 'volume_size': 1}
Feb 27 01:34:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (2fa9e466-8fa4-4f26-8ca6-ee3ef1c3cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f53ef3-5e56-46e4-8ed1-b429d528e950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f53ef3-5e56-46e4-8ed1-b429d528e950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108018674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7de4cb-d296-4778-b740-dae81e5fcdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e28502-b598-4f09-93a3-bc76e4807dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e28502-b598-4f09-93a3-bc76e4807dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf84822-836e-441b-b1df-89c33fb5d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf84822-836e-441b-b1df-89c33fb5d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7de4cb-d296-4778-b740-dae81e5fcdb1', 'volume_name': 'volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f5deac-1555-4691-978b-8a2d8083057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f5deac-1555-4691-978b-8a2d8083057c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbbdd1a-9e1c-42ad-bbc4-b90ed0cb0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Volume ca7de4cb-d296-4778-b740-dae81e5fcdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1', 'volume_size': 1}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:26 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 1073741824" returned: 0 in 0.644s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:26 devstack sudo[91533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4
Feb 27 01:34:26 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (7a9f3a01-5a03-45db-a19d-f55d472f3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed34e57e-2285-4c88-85b4-5b66d02ea252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed34e57e-2285-4c88-85b4-5b66d02ea252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1046189481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e211558-57d8-43e7-9db6-2203c22ec18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7790cd0a-42f5-4e10-8128-8bebbdba8a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7790cd0a-42f5-4e10-8128-8bebbdba8a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715faf95-a58d-41ef-a442-4b5cdbd2ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715faf95-a58d-41ef-a442-4b5cdbd2ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e211558-57d8-43e7-9db6-2203c22ec18c', 'volume_name': 'volume-3e211558-57d8-43e7-9db6-2203c22ec18c', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e295ff6-2436-4377-ab1b-e100ca086757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e295ff6-2436-4377-ab1b-e100ca086757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92956777-3826-4101-91f2-47fe9e7e366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Volume 3e211558-57d8-43e7-9db6-2203c22ec18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e211558-57d8-43e7-9db6-2203c22ec18c', 'volume_size': 1}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (28ef81b5-6209-4c85-b021-761184fc3d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c1c759-eb8d-48ae-bcc9-6e474fb588a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c1c759-eb8d-48ae-bcc9-6e474fb588a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013193896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c96a6b7-4ee3-4650-b09c-a9141987a25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:27Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b22a05-680b-4789-9acf-9708fe4abccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b22a05-680b-4789-9acf-9708fe4abccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766d17cc-2ce7-44a0-a42a-6152896e8ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766d17cc-2ce7-44a0-a42a-6152896e8ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c96a6b7-4ee3-4650-b09c-a9141987a25f', 'volume_name': 'volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ffb784-c84e-4bda-a608-80be94658226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ffb784-c84e-4bda-a608-80be94658226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61609e8-7869-4df1-8019-2cb94824bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Volume 4c96a6b7-4ee3-4650-b09c-a9141987a25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f', 'volume_size': 1}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:26 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4" returned: 0 in 0.583s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1264710150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df68bb90-e3d7-4f67-9097-07dc551c41bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5189582c1f3e4cdca94c42e3372bf561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:25Z,use_quota=True,user_id='e3a8f7bc990743a18c4e9e4b48fe7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Creating volume df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:26 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9304c8ab-a3ea-46df-a34c-5a194c95223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3223ad8e-cff4-4df9-9e37-82983c1629e4', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack sudo[91536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd 1073741824
Feb 27 01:34:26 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce39d83-c584-4190-b72c-b0ebcef57f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:26 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 (3223ad8e-cff4-4df9-9e37-82983c1629e4): created successfully
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce39d83-c584-4190-b72c-b0ebcef57f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:26 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (64083ec6-9150-49a0-b0ea-2cf29ae64c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:26 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1f688e97-c1d3-4640-995e-d9bd9ce4404a tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created volume successfully.
Feb 27 01:34:27 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd 1073741824" returned: 0 in 0.466s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:27 devstack sudo[91541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:27 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:27 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.476s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.951s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319511571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ce4342-2b5e-4b4a-8d8d-5437678fd65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Creating volume 63ce4342-2b5e-4b4a-8d8d-5437678fd65e {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:27 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73580f6d-a85c-45c1-8c2f-45c07624853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df68bb90-e3d7-4f67-9097-07dc551c41bd', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:27 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e 1073741824
Feb 27 01:34:27 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81b1956-1bd5-40ff-b088-f2ceb5b5343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:27 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Volume volume-df68bb90-e3d7-4f67-9097-07dc551c41bd (df68bb90-e3d7-4f67-9097-07dc551c41bd): created successfully
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81b1956-1bd5-40ff-b088-f2ceb5b5343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:27 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (71432961-f54d-42ce-8002-837a3b0cd94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:27 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b00ae591-aa2f-4f81-8444-3702cfceb34b tempest-VolumeDependencyTests-276539862 None] Created volume successfully.
Feb 27 01:34:28 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e 1073741824" returned: 0 in 0.477s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:28 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e
Feb 27 01:34:28 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:28 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e" returned: 0 in 0.569s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-946724721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46df6456-a55a-4cdd-89e5-e2f0748f5a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Creating volume 46df6456-a55a-4cdd-89e5-e2f0748f5a32 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:28 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61d1c29-730c-49af-872b-2bf131728462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:28 devstack sudo[91553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 1073741824
Feb 27 01:34:28 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc38a4-4d76-492a-9635-e1fe3dfce1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:28 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Volume volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e (63ce4342-2b5e-4b4a-8d8d-5437678fd65e): created successfully
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc38a4-4d76-492a-9635-e1fe3dfce1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:28 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (c1a16408-a9a0-4615-8f87-23c2afcd4dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:28 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a9ab3f4c-8959-432c-bb33-0f8e0a00ffcd tempest-CreateVolumesFromImageTest-1499588830 None] Created volume successfully.
Feb 27 01:34:29 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 1073741824" returned: 0 in 0.482s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:29 devstack sudo[91558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32
Feb 27 01:34:29 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:29 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108018674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7de4cb-d296-4778-b740-dae81e5fcdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Creating volume ca7de4cb-d296-4778-b740-dae81e5fcdb1 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:29 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14dfae-e553-40e3-a075-a6a6ff8c360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:29 devstack sudo[91561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 1073741824
Feb 27 01:34:29 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdfae47-b9ba-4aaf-9de4-8440109a2125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:29 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Volume volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 (46df6456-a55a-4cdd-89e5-e2f0748f5a32): created successfully
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdfae47-b9ba-4aaf-9de4-8440109a2125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:29 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (04d141bb-57f7-45fd-8fc8-cb1cfc0a5188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:29 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-46d56eb7-914c-4c70-aef6-54d52c703290 tempest-CreateVolumesFromImageTest-1499588830 None] Created volume successfully.
Feb 27 01:34:30 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 1073741824" returned: 0 in 0.472s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:30 devstack sudo[91566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1
Feb 27 01:34:30 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:30 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1" returned: 0 in 0.459s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.351s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1046189481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e211558-57d8-43e7-9db6-2203c22ec18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:26Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Creating volume 3e211558-57d8-43e7-9db6-2203c22ec18c {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:30 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbbdd1a-9e1c-42ad-bbc4-b90ed0cb0bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26c50ac-ba57-4c52-b975-68e1f7cc275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:30 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Volume volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 (ca7de4cb-d296-4778-b740-dae81e5fcdb1): created successfully
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26c50ac-ba57-4c52-b975-68e1f7cc275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:30 devstack sudo[91569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c 1073741824
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (2fa9e466-8fa4-4f26-8ca6-ee3ef1c3cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:30 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:30 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-b7603e62-a1a2-4c28-a617-76c2f511576e tempest-CreateVolumesFromImageTest-1499588830 None] Created volume successfully.
Feb 27 01:34:30 devstack sudo[91571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:30 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:31 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.476s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:31 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c 1073741824" returned: 0 in 0.586s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:31 devstack sudo[91577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c
Feb 27 01:34:31 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:31 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c" returned: 0 in 0.437s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.178s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013193896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c96a6b7-4ee3-4650-b09c-a9141987a25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e8171489f41ae8ba54eadb803e286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:27Z,use_quota=True,user_id='a2c8b935adc1460792f25b9dfcd830ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Creating volume 4c96a6b7-4ee3-4650-b09c-a9141987a25f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:31 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92956777-3826-4101-91f2-47fe9e7e366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e211558-57d8-43e7-9db6-2203c22ec18c', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:31 devstack sudo[91580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f 1073741824
Feb 27 01:34:31 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d44e6d4-5b00-496e-9e81-2582eb4f9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:31 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Volume volume-3e211558-57d8-43e7-9db6-2203c22ec18c (3e211558-57d8-43e7-9db6-2203c22ec18c): created successfully
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d44e6d4-5b00-496e-9e81-2582eb4f9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:31 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (7a9f3a01-5a03-45db-a19d-f55d472f3183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:31 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-da247846-a10d-4b97-a486-5de8e137f81b tempest-CreateVolumesFromImageTest-1499588830 None] Created volume successfully.
Feb 27 01:34:32 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f 1073741824" returned: 0 in 0.522s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:32 devstack sudo[91585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f
Feb 27 01:34:32 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:32 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f" returned: 0 in 0.462s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.096s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61609e8-7869-4df1-8019-2cb94824bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45336ae8-3091-4402-ab2f-02b4421ee9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating offline snapshot c41435fd-4fb3-4305-8c9f-dc76aa379d40 of volume 3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:34:32 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Volume volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f (4c96a6b7-4ee3-4650-b09c-a9141987a25f): created successfully
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45336ae8-3091-4402-ab2f-02b4421ee9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Flow 'volume_create_manager' (28ef81b5-6209-4c85-b021-761184fc3d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba278d9-4201-47ba-89ec-c862d97efe1d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:32 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:32 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a7597efa-7bbf-4195-8ec8-b8e1dae7cf9d tempest-CreateVolumesFromImageTest-1499588830 None] Created volume successfully.
Feb 27 01:34:32 devstack sudo[91588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4
Feb 27 01:34:32 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-4c96a6b7-4ee3-4650-b09c-a9141987a25f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-4c96a6b7-4ee3-4650-b09c-a9141987a25f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-quobyte-4c96a6b7-4ee3-4650-b09c-a9141987a25f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-4c96a6b7-4ee3-4650-b09c-a9141987a25f" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6108050-ec4d-4d20-9355-e9c73eca621d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:33 devstack sudo[91590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f
Feb 27 01:34:33 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:33 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4" returned: 0 in 0.499s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:33 devstack sudo[91595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 1G
Feb 27 01:34:33 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:33 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f" returned: 0 in 0.586s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:33 devstack sudo[91603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f
Feb 27 01:34:33 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:33 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 1G" returned: 0 in 0.526s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:33 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:33 devstack sudo[91605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40
Feb 27 01:34:33 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:34 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-4c96a6b7-4ee3-4650-b09c-a9141987a25f" returned: 0 in 0.490s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-4c96a6b7-4ee3-4650-b09c-a9141987a25f" released by "delete_volume" :: held 1.099s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Created reservations ['b0a5a2a2-3e64-4cbe-8a50-6baf04951581', '10788c63-0264-4d9e-9fdf-b101c8b63574', 'fe4a5d51-6d2e-4423-8e12-acd57837828c', '92d6176f-fc50-4ba4-a01c-800203506fdf'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:34 devstack sudo[91613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:34 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:34 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:34 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 is being set with open permissions: ugo+rw
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:34 devstack sudo[91615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40
Feb 27 01:34:34 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:34 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40" returned: 0 in 0.390s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:34 devstack sudo[91619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info
Feb 27 01:34:34 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:34 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.482s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:34 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Deleted volume successfully.
Feb 27 01:34:34 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a5d3ac99-ce6f-4439-b7a4-e6dabf481e29 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-4c96a6b7-4ee3-4650-b09c-a9141987a25f-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:35 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:35 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info is being set with open permissions: ugo+rw
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:35 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info
Feb 27 01:34:35 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-3e211558-57d8-43e7-9db6-2203c22ec18c-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-3e211558-57d8-43e7-9db6-2203c22ec18c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-quobyte-3e211558-57d8-43e7-9db6-2203c22ec18c" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-3e211558-57d8-43e7-9db6-2203c22ec18c" acquired by "delete_volume" :: waited 0.006s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e13163-18b2-498b-ac3c-4ab311397770]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:35 devstack sudo[91624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c
Feb 27 01:34:35 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:35 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.info" returned: 0 in 0.483s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.028s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Creating offline snapshot 1704100f-94f8-4c11-aea7-9b3725210dc4 of volume df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:34:35 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-65d3eccc-ee87-44be-8009-80c5704fd364 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Create snapshot completed successfully
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7768af8-1c27-432f-bf66-3da49d707191]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:35 devstack sudo[91627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:35 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:35 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c" returned: 0 in 0.518s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:35 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:35 devstack sudo[91632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c
Feb 27 01:34:35 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:36 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (64fdbde5-ca2b-4d6b-bc7f-71f559f35686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddd070a-aeed-4495-9559-fb6d1427f64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.551s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddd070a-aeed-4495-9559-fb6d1427f64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992239814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f269cd-309a-492d-8fd9-99a01ed66eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:36Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:36 devstack sudo[91638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 1G
Feb 27 01:34:36 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcf37d3-fd8a-40ef-8d0d-71b32e5a19dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcf37d3-fd8a-40ef-8d0d-71b32e5a19dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c5afa8-2f6d-40a0-93a6-25229b934334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c5afa8-2f6d-40a0-93a6-25229b934334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f269cd-309a-492d-8fd9-99a01ed66eb9', 'volume_name': 'volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99a63a3-b4bf-4d4a-b033-2d0378eabeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99a63a3-b4bf-4d4a-b033-2d0378eabeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f898a61-3d0a-4f11-93de-e48f4af95a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume c0f269cd-309a-492d-8fd9-99a01ed66eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9', 'volume_size': 1}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3e211558-57d8-43e7-9db6-2203c22ec18c" returned: 0 in 0.524s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-3e211558-57d8-43e7-9db6-2203c22ec18c" released by "delete_volume" :: held 1.063s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Created reservations ['0b6baf3f-55fd-446a-b7b2-55dbee5711d5', '44d1203e-eaf9-4546-b80d-2b3fa9f13985', '929083f9-af40-4657-97d0-aa32d73efc25', '0a5e5e92-6ec6-4fd0-b6af-6d5a7f809fd3'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (505855e6-8ec8-44d9-a06a-bcf13dc6f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e105656e-919e-469c-81ce-91136cb58058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack sudo[91640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:36 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e105656e-919e-469c-81ce-91136cb58058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004357721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f38506-e754-4419-966b-f36138d6833f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:36Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdd5f69-ccc1-4d49-9b87-dc9677c420a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdd5f69-ccc1-4d49-9b87-dc9677c420a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8026e9a3-0b8d-4fb8-85ad-4256954f7a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8026e9a3-0b8d-4fb8-85ad-4256954f7a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f38506-e754-4419-966b-f36138d6833f', 'volume_name': 'volume-e9f38506-e754-4419-966b-f36138d6833f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6feea54-0315-422f-a186-1c8f5b561957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6feea54-0315-422f-a186-1c8f5b561957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7af090c-8eef-4213-97cc-17413035f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume e9f38506-e754-4419-966b-f36138d6833f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f38506-e754-4419-966b-f36138d6833f', 'volume_size': 1}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (198b41de-52df-4b3c-983e-d647c27ab697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88972671-3f87-4bc1-9cdf-5c717ece27a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88972671-3f87-4bc1-9cdf-5c717ece27a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959744856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca37795f-f0b9-4408-ada6-6f4e07936cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:37Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78e0af-7e09-413e-b1e6-0954f23c15a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78e0af-7e09-413e-b1e6-0954f23c15a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2680d296-e8c6-452e-b2b6-d702836fa7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2680d296-e8c6-452e-b2b6-d702836fa7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca37795f-f0b9-4408-ada6-6f4e07936cf2', 'volume_name': 'volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb039576-9f38-4967-bcfe-8042200949c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb039576-9f38-4967-bcfe-8042200949c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d757290a-8935-4a8f-ada2-aa28ed4a5e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume ca37795f-f0b9-4408-ada6-6f4e07936cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2', 'volume_size': 1}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (e7851cd7-9785-46e5-a53b-35e7854595fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e823db-6bcd-4366-812a-f5cbf7a13b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e823db-6bcd-4366-812a-f5cbf7a13b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406494914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f112bb0d-0518-481f-83a4-233e1d7d1c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:37Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7519897b-6ee0-404b-bda1-3aee19a570b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7519897b-6ee0-404b-bda1-3aee19a570b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8072a2-ef05-4ccf-b884-fcc987736718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8072a2-ef05-4ccf-b884-fcc987736718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f112bb0d-0518-481f-83a4-233e1d7d1c79', 'volume_name': 'volume-f112bb0d-0518-481f-83a4-233e1d7d1c79', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e812292f-fe4b-4786-b43e-67d89436a4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e812292f-fe4b-4786-b43e-67d89436a4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c2ff6b-0a4f-488f-b30a-02721e296a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:36 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume f112bb0d-0518-481f-83a4-233e1d7d1c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f112bb0d-0518-481f-83a4-233e1d7d1c79', 'volume_size': 1}
Feb 27 01:34:36 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (5b6d2669-084b-4247-a607-22319528f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360f0dcd-68a6-466d-944c-cb70d80def8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360f0dcd-68a6-466d-944c-cb70d80def8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611350399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1330a749-db5b-4106-8693-a0fa8fdcac15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:37Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5669e53-ce9d-495f-9157-737c4412ced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5669e53-ce9d-495f-9157-737c4412ced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ac7b83-511f-442a-bb82-fa1e371d78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ac7b83-511f-442a-bb82-fa1e371d78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1330a749-db5b-4106-8693-a0fa8fdcac15', 'volume_name': 'volume-1330a749-db5b-4106-8693-a0fa8fdcac15', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a040042b-a4b4-4be5-af8f-b85948d3284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a040042b-a4b4-4be5-af8f-b85948d3284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079cd871-13ec-4cf9-b082-a19a3ab0636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:37 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume 1330a749-db5b-4106-8693-a0fa8fdcac15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1330a749-db5b-4106-8693-a0fa8fdcac15', 'volume_size': 1}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:37 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.723s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:37 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Deleted volume successfully.
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-3e9b4b6d-d314-4bfb-9179-c9bd28b10096 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-3e211558-57d8-43e7-9db6-2203c22ec18c-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:37 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 1G" returned: 0 in 0.925s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df68bb90-e3d7-4f67-9097-07dc551c41bd -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:37 devstack sudo[91646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df68bb90-e3d7-4f67-9097-07dc551c41bd -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4
Feb 27 01:34:37 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-ca7de4cb-d296-4778-b740-dae81e5fcdb1-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-ca7de4cb-d296-4778-b740-dae81e5fcdb1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:UPDATE=120,cinder:DELETE=12,cinder:SELECT=91,cinder:INSERT=29 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-quobyte-ca7de4cb-d296-4778-b740-dae81e5fcdb1" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-ca7de4cb-d296-4778-b740-dae81e5fcdb1" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2801a54d-8c1e-4d08-a449-db6e2c27739c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:37 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1
Feb 27 01:34:37 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:37 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df68bb90-e3d7-4f67-9097-07dc551c41bd -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:37 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 is being set with open permissions: ugo+rw
Feb 27 01:34:37 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:37 devstack sudo[91654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4
Feb 27 01:34:37 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:38 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1" returned: 0 in 0.546s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:38 devstack sudo[91660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1
Feb 27 01:34:38 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:38 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4" returned: 0 in 0.446s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:38 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info
Feb 27 01:34:38 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:38 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca7de4cb-d296-4778-b740-dae81e5fcdb1" returned: 0 in 0.532s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-ca7de4cb-d296-4778-b740-dae81e5fcdb1" released by "delete_volume" :: held 1.106s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Created reservations ['c559b2c4-259e-4eea-bbf6-43211a36e7ed', '936574b7-05f6-4c21-9844-0f2d056c7666', '6e53c8f8-b407-4b49-b2af-f224a56a1d5b', '5611fc58-715c-44eb-b7ef-11f36dc812f6'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:38 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info" returned: 0 in 0.533s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:38 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info is being set with open permissions: ugo+rw
Feb 27 01:34:38 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:38 devstack sudo[91666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:38 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:38 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info
Feb 27 01:34:38 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:39 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.info" returned: 0 in 0.495s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.548s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.901s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992239814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f269cd-309a-492d-8fd9-99a01ed66eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:36Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating volume c0f269cd-309a-492d-8fd9-99a01ed66eb9 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:39 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:39 devstack sudo[91672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 1073741824
Feb 27 01:34:39 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:39 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG dbcounter [-] [83910] Writing DB stats cinder:SELECT=123,cinder:UPDATE=152,cinder:INSERT=34,cinder:DELETE=13 {{(pid=83910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:34:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-79e98335-4e5e-483d-a90b-3c0250807f99 tempest-VolumeDependencyTests-276539862 None] Create snapshot completed successfully
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.567s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:39 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Deleted volume successfully.
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-4b0e2492-e950-45da-bd52-fa9ccc4e375b tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-ca7de4cb-d296-4778-b740-dae81e5fcdb1-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-46df6456-a55a-4cdd-89e5-e2f0748f5a32-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-46df6456-a55a-4cdd-89e5-e2f0748f5a32-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-quobyte-46df6456-a55a-4cdd-89e5-e2f0748f5a32" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-46df6456-a55a-4cdd-89e5-e2f0748f5a32" acquired by "delete_volume" :: waited 0.014s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7d4c02-67d3-484b-8e22-7ba3483eab64]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:39 devstack sudo[91677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32
Feb 27 01:34:39 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:39 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 1073741824" returned: 0 in 0.621s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:39 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:39 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9
Feb 27 01:34:39 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Flow 'volume_create_manager' (9a3b2330-9af9-4395-8563-d7b86103e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df740553-72ef-4988-b302-7f26e4d4b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df740553-72ef-4988-b302-7f26e4d4b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1155905970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e33777-180b-4340-ad00-de8519486436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19919bf774d1489cf135bd2093727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:40Z,use_quota=True,user_id='3c1f6e0793f249958af29034a33e4f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cbb65d-11aa-422c-b46f-e10b1cac1f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cbb65d-11aa-422c-b46f-e10b1cac1f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b07c0a1-d1b8-44fe-b4f2-e352ce2f5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b07c0a1-d1b8-44fe-b4f2-e352ce2f5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e33777-180b-4340-ad00-de8519486436', 'volume_name': 'volume-18e33777-180b-4340-ad00-de8519486436', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a071ea-c6da-451b-a5fa-9d79da6e9308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a071ea-c6da-451b-a5fa-9d79da6e9308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705ad7b3-24bd-4b73-96d0-d886e9bb5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Volume 18e33777-180b-4340-ad00-de8519486436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e33777-180b-4340-ad00-de8519486436', 'volume_size': 1}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:40 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32" returned: 0 in 0.624s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:40 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9" returned: 0 in 0.525s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.909s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004357721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f38506-e754-4419-966b-f36138d6833f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:36Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating volume e9f38506-e754-4419-966b-f36138d6833f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:40 devstack sudo[91685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32
Feb 27 01:34:40 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:40 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f898a61-3d0a-4f11-93de-e48f4af95a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f 1073741824
Feb 27 01:34:40 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b25552d-4a38-4cde-bd26-627da75fbcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 (c0f269cd-309a-492d-8fd9-99a01ed66eb9): created successfully
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b25552d-4a38-4cde-bd26-627da75fbcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (64fdbde5-ca2b-4d6b-bc7f-71f559f35686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:40 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-021257cf-b09e-4595-a6b4-edb848d65ea7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created volume successfully.
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (7f259d80-79c3-46aa-9fdc-51dde9fe0999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b203a424-ca60-4e72-ad89-c66a37e39755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b203a424-ca60-4e72-ad89-c66a37e39755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1841374381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172ce04c-d34e-4408-9e38-82b6237c95a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5189582c1f3e4cdca94c42e3372bf561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1704100f-94f8-4c11-aea7-9b3725210dc4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:41Z,use_quota=True,user_id='e3a8f7bc990743a18c4e9e4b48fe7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928fc71c-9a9c-40e8-9486-8e47d3e74599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928fc71c-9a9c-40e8-9486-8e47d3e74599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c91f97-f0eb-4d6b-97e0-9359dd6b2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c91f97-f0eb-4d6b-97e0-9359dd6b2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '172ce04c-d34e-4408-9e38-82b6237c95a3', 'volume_name': 'volume-172ce04c-d34e-4408-9e38-82b6237c95a3', 'volume_size': 1, 'snapshot_id': '1704100f-94f8-4c11-aea7-9b3725210dc4'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4a562-633f-4c9e-9005-acfd2f8ff8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4a562-633f-4c9e-9005-acfd2f8ff8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4677f9-11d3-48e8-a94b-bb68ae67671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:40 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Volume 172ce04c-d34e-4408-9e38-82b6237c95a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-172ce04c-d34e-4408-9e38-82b6237c95a3', 'volume_size': 1, 'snapshot_id': '1704100f-94f8-4c11-aea7-9b3725210dc4'}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:40 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-46df6456-a55a-4cdd-89e5-e2f0748f5a32" returned: 0 in 0.445s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-46df6456-a55a-4cdd-89e5-e2f0748f5a32" released by "delete_volume" :: held 1.094s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Created reservations ['692c5c0a-e538-4996-a028-bc9de886bc30', '797e59a4-c953-4cd9-8374-687fb8facc6d', '3e025be6-b335-4d43-8c55-b1177d8844af', '72f66444-f723-48c2-b5a8-fe8b9bbf0a31'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:40 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:40 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:40 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:40 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f 1073741824" returned: 0 in 0.517s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:41 devstack sudo[91695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f
Feb 27 01:34:41 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:41 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.390s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Deleted volume successfully.
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-f5d4a1ad-a852-428a-bf5b-30f885d2d292 tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-46df6456-a55a-4cdd-89e5-e2f0748f5a32-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:41 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f" returned: 0 in 0.410s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.745s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959744856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca37795f-f0b9-4408-ada6-6f4e07936cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:37Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating volume ca37795f-f0b9-4408-ada6-6f4e07936cf2 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:41 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7af090c-8eef-4213-97cc-17413035f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f38506-e754-4419-966b-f36138d6833f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fec3c0d-92c6-42c7-a6a7-6d8553f01b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:41 devstack sudo[91699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 1073741824
Feb 27 01:34:41 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:41 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume volume-e9f38506-e754-4419-966b-f36138d6833f (e9f38506-e754-4419-966b-f36138d6833f): created successfully
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fec3c0d-92c6-42c7-a6a7-6d8553f01b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (505855e6-8ec8-44d9-a06a-bcf13dc6f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:41 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6f8361c2-8af4-442c-b1c0-30114eb35342 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created volume successfully.
Feb 27 01:34:41 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 1073741824" returned: 0 in 0.466s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-63ce4342-2b5e-4b4a-8d8d-5437678fd65e-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-63ce4342-2b5e-4b4a-8d8d-5437678fd65e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:41 devstack sudo[91710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2
Feb 27 01:34:41 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "cinder-quobyte-63ce4342-2b5e-4b4a-8d8d-5437678fd65e" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-63ce4342-2b5e-4b4a-8d8d-5437678fd65e" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4923b15a-c96c-44b1-ae2e-76dd056efa39]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:41 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:42 devstack sudo[91712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e
Feb 27 01:34:42 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:42 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2" returned: 0 in 0.404s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.336s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406494914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f112bb0d-0518-481f-83a4-233e1d7d1c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:37Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating volume f112bb0d-0518-481f-83a4-233e1d7d1c79 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:42 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d757290a-8935-4a8f-ada2-aa28ed4a5e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c52d51e-1842-4355-b9d4-83f3b96839d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:42 devstack sudo[91715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 1073741824
Feb 27 01:34:42 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:42 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 (ca37795f-f0b9-4408-ada6-6f4e07936cf2): created successfully
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c52d51e-1842-4355-b9d4-83f3b96839d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (198b41de-52df-4b3c-983e-d647c27ab697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:42 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a9b727d3-5f32-4c31-89f5-56d2605947b5 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created volume successfully.
Feb 27 01:34:42 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e" returned: 0 in 0.461s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:42 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e
Feb 27 01:34:42 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:42 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 1073741824" returned: 0 in 0.504s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:42 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79
Feb 27 01:34:42 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:42 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-63ce4342-2b5e-4b4a-8d8d-5437678fd65e" returned: 0 in 0.449s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-quobyte-63ce4342-2b5e-4b4a-8d8d-5437678fd65e" released by "delete_volume" :: held 0.934s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Created reservations ['e6b73820-8f09-45b8-8dce-16ae8f68e572', '925124cd-4cf8-4a8e-9c86-6848387820b5', '24289e6a-dfc3-4f28-b830-483a15b346c1', 'b5b660ad-e775-4fdc-98d1-0d6ebb5cc265'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:42 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:42 devstack sudo[91728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:42 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:43 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79" returned: 0 in 0.413s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.094s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611350399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1330a749-db5b-4106-8693-a0fa8fdcac15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821af60ceb56439889abfe6c4fdcdc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:37Z,use_quota=True,user_id='ee68364c4ba048688fb624a59cef8251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Creating volume 1330a749-db5b-4106-8693-a0fa8fdcac15 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:43 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c2ff6b-0a4f-488f-b30a-02721e296a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f112bb0d-0518-481f-83a4-233e1d7d1c79', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44f433a-49c8-4ed1-9549-0d43b3aa90cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:43 devstack sudo[91731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15 1073741824
Feb 27 01:34:43 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:43 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 (f112bb0d-0518-481f-83a4-233e1d7d1c79): created successfully
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44f433a-49c8-4ed1-9549-0d43b3aa90cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (e7851cd7-9785-46e5-a53b-35e7854595fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-130133b4-294b-4be0-b087-17538e196571 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created volume successfully.
Feb 27 01:34:43 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.469s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:43 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Deleted volume successfully.
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-1044445c-41cc-40c3-b5c1-a1ce2d30352d tempest-CreateVolumesFromImageTest-1499588830 None] Lock "cinder-63ce4342-2b5e-4b4a-8d8d-5437678fd65e-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:43 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15 1073741824" returned: 0 in 0.572s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:43 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:43 devstack sudo[91737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15
Feb 27 01:34:43 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:44 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15" returned: 0 in 0.433s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.008s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1155905970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e33777-180b-4340-ad00-de8519486436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19919bf774d1489cf135bd2093727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:40Z,use_quota=True,user_id='3c1f6e0793f249958af29034a33e4f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Creating volume 18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:44 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079cd871-13ec-4cf9-b082-a19a3ab0636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1330a749-db5b-4106-8693-a0fa8fdcac15', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b54e87-6963-4aac-949c-7fc7779132e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:44 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 1073741824
Feb 27 01:34:44 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:44 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Volume volume-1330a749-db5b-4106-8693-a0fa8fdcac15 (1330a749-db5b-4106-8693-a0fa8fdcac15): created successfully
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b54e87-6963-4aac-949c-7fc7779132e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Flow 'volume_create_manager' (5b6d2669-084b-4247-a607-22319528f48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:44 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-46fbbe95-d6d2-4a67-ae70-a53fa6a2ae20 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created volume successfully.
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (2022c0c9-5786-4fc7-8f13-6a39382a0527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d8f6d8-8744-40e2-97b1-7de80313fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-1330a749-db5b-4106-8693-a0fa8fdcac15-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d8f6d8-8744-40e2-97b1-7de80313fbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423964743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7659a4cc-f0e2-4a19-8c29-cec1924608b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:45Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddedbb3-8e03-484a-b9cd-f2f88af64a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddedbb3-8e03-484a-b9cd-f2f88af64a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dbe2d2-6337-4377-9553-763c37b2c43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dbe2d2-6337-4377-9553-763c37b2c43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7659a4cc-f0e2-4a19-8c29-cec1924608b0', 'volume_name': 'volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49273cd-fe7e-40ce-a209-eccfbd77b371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49273cd-fe7e-40ce-a209-eccfbd77b371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59ba671-d24a-48c8-b2aa-0bc9fbbf85ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:44 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume 7659a4cc-f0e2-4a19-8c29-cec1924608b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0', 'volume_size': 1}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:44 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 1073741824" returned: 0 in 0.553s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-1330a749-db5b-4106-8693-a0fa8fdcac15-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:44 devstack sudo[91745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:34:44 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-1330a749-db5b-4106-8693-a0fa8fdcac15" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-1330a749-db5b-4106-8693-a0fa8fdcac15" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[796a1be3-9425-4966-9124-46af25a36bc5]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:44 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:45 devstack sudo[91747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15
Feb 27 01:34:45 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:45 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.378s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.653s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-1704100f-94f8-4c11-aea7-9b3725210dc4-172ce04c-d34e-4408-9e38-82b6237c95a3" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705ad7b3-24bd-4b73-96d0-d886e9bb5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e33777-180b-4340-ad00-de8519486436', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebf4949-e8c7-4539-ab2b-55e204d30654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-1704100f-94f8-4c11-aea7-9b3725210dc4-172ce04c-d34e-4408-9e38-82b6237c95a3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Creating volume 172ce04c-d34e-4408-9e38-82b6237c95a3 from snapshot 1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-172ce04c-d34e-4408-9e38-82b6237c95a3" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:45 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Volume volume-18e33777-180b-4340-ad00-de8519486436 (18e33777-180b-4340-ad00-de8519486436): created successfully
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebf4949-e8c7-4539-ab2b-55e204d30654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Flow 'volume_create_manager' (9a3b2330-9af9-4395-8563-d7b86103e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:45 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-1b629a51-b7f6-4fb6-b74e-c6b4da546799 tempest-SnapshotDependencyTests-609615862 None] Created volume successfully.
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-172ce04c-d34e-4408-9e38-82b6237c95a3" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] snapshot: 1704100f-94f8-4c11-aea7-9b3725210dc4, volume: 172ce04c-d34e-4408-9e38-82b6237c95a3,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[37780824-c955-4929-bd03-aac1a9d7a6fe]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:45 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15" returned: 0 in 0.472s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:45 devstack sudo[91754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15
Feb 27 01:34:45 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:45 devstack sudo[91753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4
Feb 27 01:34:45 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:45 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-1330a749-db5b-4106-8693-a0fa8fdcac15" returned: 0 in 0.380s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-1330a749-db5b-4106-8693-a0fa8fdcac15" released by "delete_volume" :: held 0.872s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['531510a4-5d1a-4cf0-a658-fe905fd792a5', 'f928eb80-84b2-496d-95f2-6df32926c162', 'b4fa51e7-7f54-4494-88ef-f4aae74caf1d', 'b71b491c-d406-49ee-b639-6c331211e3e9'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:45 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4" returned: 0 in 0.517s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df68bb90-e3d7-4f67-9097-07dc551c41bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a416a80-1ce2-4aef-ac9b-80f82df78726]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:45 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:45 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-f112bb0d-0518-481f-83a4-233e1d7d1c79-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-f112bb0d-0518-481f-83a4-233e1d7d1c79-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:45 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:45 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:45 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-f112bb0d-0518-481f-83a4-233e1d7d1c79" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-f112bb0d-0518-481f-83a4-233e1d7d1c79" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[897e6d66-2d45-433a-abf8-938fc79e2d44]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:46 devstack sudo[91765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79
Feb 27 01:34:46 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:46 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.454s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:46 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleted volume successfully.
Feb 27 01:34:46 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-dbdc94d3-05da-4e39-8e31-4f905702d7c1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-1330a749-db5b-4106-8693-a0fa8fdcac15-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.507s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:46 devstack sudo[91783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3
Feb 27 01:34:46 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:46 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79" returned: 0 in 0.534s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:46 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:46 devstack sudo[91808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79
Feb 27 01:34:46 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:47 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-f112bb0d-0518-481f-83a4-233e1d7d1c79" returned: 0 in 0.771s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-f112bb0d-0518-481f-83a4-233e1d7d1c79" released by "delete_volume" :: held 1.333s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['89a799cd-6981-4f1f-8fe9-b40aa46ef60e', '10973c07-07c6-4641-b3de-525f31a69a11', 'f5b625a5-7f81-4dfb-a6a4-bcceba587aab', '896e174a-fd9b-462f-b758-7023e614b82c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:47 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:47 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:47 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-ca37795f-f0b9-4408-ada6-6f4e07936cf2-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-ca37795f-f0b9-4408-ada6-6f4e07936cf2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:48 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.787s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:48 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleted volume successfully.
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-ca37795f-f0b9-4408-ada6-6f4e07936cf2" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-58723a43-2845-4539-8a95-11bfd7f81074 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-f112bb0d-0518-481f-83a4-233e1d7d1c79-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-ca37795f-f0b9-4408-ada6-6f4e07936cf2" acquired by "delete_volume" :: waited 0.054s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257c5ab-022e-49a9-9508-399a09eb0d73]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:48 devstack sudo[91827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2
Feb 27 01:34:48 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:48 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3" returned: 0 in 2.185s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab9a5b4-6627-4a9f-829d-3e2a9deae28a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:48 devstack sudo[91829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:48 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:48 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2" returned: 0 in 0.488s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:48 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:49 devstack sudo[91835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2
Feb 27 01:34:49 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:49 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.591s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:34:49 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Converted 1024.00 MB image at 468.27 MB/s
Feb 27 01:34:49 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 is being set with open permissions: ugo+rw
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:49 devstack sudo[91839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3
Feb 27 01:34:49 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:49 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-ca37795f-f0b9-4408-ada6-6f4e07936cf2" returned: 0 in 0.390s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-ca37795f-f0b9-4408-ada6-6f4e07936cf2" released by "delete_volume" :: held 0.927s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['25652f20-cb25-4564-9578-6a5b4135e915', 'ba40e80b-fe46-44f0-87b2-abc9bbb1b5c8', '4cf5c067-18e5-46da-9a7f-fd2be25e3f0d', '84f5e18b-0814-4ca5-8dc5-ccae6c707c2a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:49 devstack sudo[91842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:49 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:49 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3" returned: 0 in 0.414s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-172ce04c-d34e-4408-9e38-82b6237c95a3" released by "_copy_volume_from_snapshot" :: held 4.280s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-1704100f-94f8-4c11-aea7-9b3725210dc4-172ce04c-d34e-4408-9e38-82b6237c95a3" released by "_create_volume_from_snapshot" :: held 4.316s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.337s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.749s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423964743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7659a4cc-f0e2-4a19-8c29-cec1924608b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:45Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Creating volume 7659a4cc-f0e2-4a19-8c29-cec1924608b0 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:49 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:49 devstack sudo[91845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 1073741824
Feb 27 01:34:49 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4677f9-11d3-48e8-a94b-bb68ae67671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172ce04c-d34e-4408-9e38-82b6237c95a3', 'volume_size': 1, 'snapshot_id': '1704100f-94f8-4c11-aea7-9b3725210dc4'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304c9b0e-1270-402e-8dc6-5414d4d08a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:49 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Volume volume-172ce04c-d34e-4408-9e38-82b6237c95a3 (172ce04c-d34e-4408-9e38-82b6237c95a3): created successfully
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304c9b0e-1270-402e-8dc6-5414d4d08a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (7f259d80-79c3-46aa-9fdc-51dde9fe0999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:49 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c64caef6-cb0b-40a0-9b73-09713a41b1fe tempest-VolumeDependencyTests-276539862 None] Created volume successfully.
Feb 27 01:34:49 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.395s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:49 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleted volume successfully.
Feb 27 01:34:49 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-20c80490-6fcb-44db-bce6-503d93f32ec0 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-ca37795f-f0b9-4408-ada6-6f4e07936cf2-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-1704100f-94f8-4c11-aea7-9b3725210dc4-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-1704100f-94f8-4c11-aea7-9b3725210dc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-df68bb90-e3d7-4f67-9097-07dc551c41bd" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-df68bb90-e3d7-4f67-9097-07dc551c41bd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-1704100f-94f8-4c11-aea7-9b3725210dc4" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-1704100f-94f8-4c11-aea7-9b3725210dc4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Deleting offline snapshot 1704100f-94f8-4c11-aea7-9b3725210dc4 of volume df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] snapshot_file for this snap is: volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e03ee4d-3169-4a86-b1f9-0544e2ca004a]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:50 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 1073741824" returned: 0 in 0.527s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:50 devstack sudo[91852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0
Feb 27 01:34:50 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:50 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4
Feb 27 01:34:50 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-e9f38506-e754-4419-966b-f36138d6833f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-e9f38506-e754-4419-966b-f36138d6833f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-e9f38506-e754-4419-966b-f36138d6833f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-e9f38506-e754-4419-966b-f36138d6833f" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ec26a-67b8-4a51-95bf-594693ec6fdb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:50 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0" returned: 0 in 0.435s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.945s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:50 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f
Feb 27 01:34:50 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59ba671-d24a-48c8-b2aa-0bc9fbbf85ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f1c398-e287-4493-b76e-456629b4936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Creating offline snapshot c969f9ee-07cb-4b47-933d-6a60bec24f5a of volume 18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:34:50 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4" returned: 0 in 0.508s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:50 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 (7659a4cc-f0e2-4a19-8c29-cec1924608b0): created successfully
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f1c398-e287-4493-b76e-456629b4936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (2022c0c9-5786-4fc7-8f13-6a39382a0527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df68bb90-e3d7-4f67-9097-07dc551c41bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65dc199-11fc-44d8-a822-9a10414a067d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f5dd1-e894-4547-9436-23d27f5aedf3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:50 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:50 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-68668ca9-fecf-49c6-9300-e680d6ac06c3 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created volume successfully.
Feb 27 01:34:50 devstack sudo[91861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:34:50 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:50 devstack sudo[91862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:50 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:51 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f" returned: 0 in 0.474s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:51 devstack sudo[91868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f
Feb 27 01:34:51 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:51 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.514s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:51 devstack sudo[91876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a 1G
Feb 27 01:34:51 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:51 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.555s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:51 devstack sudo[91878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4
Feb 27 01:34:51 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:51 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e9f38506-e754-4419-966b-f36138d6833f" returned: 0 in 0.477s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-e9f38506-e754-4419-966b-f36138d6833f" released by "delete_volume" :: held 0.973s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (a0585e9a-3459-46d3-a95a-d2005323c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbf3e4b-b413-4448-bf34-a772bbabd39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbf3e4b-b413-4448-bf34-a772bbabd39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-898308566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e707f10b-5e15-4303-8742-8fcf2c2e7c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:51Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506155b5-7bb2-4f9e-9254-c2777b1cc990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506155b5-7bb2-4f9e-9254-c2777b1cc990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5303b84-88ad-4315-8598-7fee54eb7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5303b84-88ad-4315-8598-7fee54eb7fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e707f10b-5e15-4303-8742-8fcf2c2e7c71', 'volume_name': 'volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3766cc58-9c58-42d9-88bc-80cd2d8c8dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3766cc58-9c58-42d9-88bc-80cd2d8c8dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4dd8a4-7fa6-47a4-82d7-6b842b70d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume e707f10b-5e15-4303-8742-8fcf2c2e7c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71', 'volume_size': 1}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['aac4829f-7869-49a1-a879-5cca81b0e656', '08c2b3f5-46b3-4a2d-b2f5-74c0493b6d5b', '516262c6-61f8-47b5-99d8-61abc5975f37', '986a254e-8aa3-48dd-99ea-2adbf5787b46'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:51 devstack sudo[91882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:51 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (15562916-2cc1-44e6-8411-1dd697d486cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2bf436-b63c-4749-b7be-c6f34e1d591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2bf436-b63c-4749-b7be-c6f34e1d591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-591084903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb9b64-724a-468c-b069-98c3063c2b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3a9ebc-f002-43cd-95d0-62acf2d87f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3a9ebc-f002-43cd-95d0-62acf2d87f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7915a2-7441-462b-9297-647766a8c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7915a2-7441-462b-9297-647766a8c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fb9b64-724a-468c-b069-98c3063c2b7f', 'volume_name': 'volume-a2fb9b64-724a-468c-b069-98c3063c2b7f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bcc0f4-e1a1-4c72-9682-78ec24b06dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bcc0f4-e1a1-4c72-9682-78ec24b06dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d334c1-bbe4-411c-be25-8f9338dd400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume a2fb9b64-724a-468c-b069-98c3063c2b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fb9b64-724a-468c-b069-98c3063c2b7f', 'volume_size': 1}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:51 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4" returned: 0 in 0.681s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:51 devstack sudo[91890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4
Feb 27 01:34:51 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (45df48e6-59f2-44bb-838b-4d975b30c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:51 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132199f6-9cb5-438e-b0f1-df443da1e9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a 1G" returned: 0 in 0.800s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:51 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e33777-180b-4340-ad00-de8519486436 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132199f6-9cb5-438e-b0f1-df443da1e9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1002500873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cf548c-a719-486b-8e5c-26f6d99e22ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414f47fa-5234-475d-9730-2f1f9792b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414f47fa-5234-475d-9730-2f1f9792b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640c8c5f-b5b9-4e81-907b-95279fee34b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640c8c5f-b5b9-4e81-907b-95279fee34b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cf548c-a719-486b-8e5c-26f6d99e22ef', 'volume_name': 'volume-72cf548c-a719-486b-8e5c-26f6d99e22ef', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2162389-870f-46b0-b53a-86cfdda2af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack sudo[91892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e33777-180b-4340-ad00-de8519486436 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2162389-870f-46b0-b53a-86cfdda2af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587a65e2-d8b2-46cb-a91f-0c1fc6975ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume 72cf548c-a719-486b-8e5c-26f6d99e22ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cf548c-a719-486b-8e5c-26f6d99e22ef', 'volume_size': 1}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (acbc121e-6d22-4c3a-b86c-36a2de3ead3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8e476c-a780-4d8e-886e-e2247d35eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8e476c-a780-4d8e-886e-e2247d35eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75921714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af0420e-1468-4a57-bd98-871ee97ebb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91766ee9-0e83-40ed-94c9-9f960eb5d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91766ee9-0e83-40ed-94c9-9f960eb5d37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5891dc-fe05-437d-bfea-2355c24fbdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5891dc-fe05-437d-bfea-2355c24fbdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af0420e-1468-4a57-bd98-871ee97ebb7d', 'volume_name': 'volume-0af0420e-1468-4a57-bd98-871ee97ebb7d', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44731f48-d23c-480c-b434-c28af607e9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44731f48-d23c-480c-b434-c28af607e9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da57b80-f40c-483e-8bdc-706f57c33b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume 0af0420e-1468-4a57-bd98-871ee97ebb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af0420e-1468-4a57-bd98-871ee97ebb7d', 'volume_size': 1}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.609s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleted volume successfully.
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-94cc842d-007e-4c48-ae43-66a6e2299358 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-e9f38506-e754-4419-966b-f36138d6833f-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:52 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (3e6bebec-2359-4d5f-8c41-b6d14427eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469c4a4-86da-45bb-873d-b5cf77626ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469c4a4-86da-45bb-873d-b5cf77626ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-80257134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd418651-b53f-4b16-b4ba-50a87b5eb23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd418651-b53f-4b16-b4ba-50a87b5eb23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f42699-42eb-4840-9476-1dc08e6abdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f42699-42eb-4840-9476-1dc08e6abdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a', 'volume_name': 'volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3942bc-f52c-4c9e-9ecf-2b8c2aadd5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3942bc-f52c-4c9e-9ecf-2b8c2aadd5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fee50cc-64c7-4628-9d17-09defe2b20de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:52 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume 98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a', 'volume_size': 1}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd.1704100f-94f8-4c11-aea7-9b3725210dc4" returned: 0 in 0.594s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:52 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e33777-180b-4340-ad00-de8519486436 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a" returned: 0 in 0.547s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:52 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a is being set with open permissions: ugo+rw
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-1704100f-94f8-4c11-aea7-9b3725210dc4" released by "_delete_snapshot" :: held 2.423s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-df68bb90-e3d7-4f67-9097-07dc551c41bd" released by "delete_snapshot" :: held 2.438s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:52 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a
Feb 27 01:34:52 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Created reservations ['87e42d27-3f16-410c-8bf7-522b394d21e1', '6f6e4988-366a-4710-8c0f-fb99287e4c67', '59516d91-25af-4ee5-a2aa-045aaf58975f', '660d2541-ae4e-4c5c-a6eb-c8cd6a492ea0'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:52 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Delete snapshot completed successfully.
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-a7a376cb-70e1-4158-96ab-f848d438cda8 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-1704100f-94f8-4c11-aea7-9b3725210dc4-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-c0f269cd-309a-492d-8fd9-99a01ed66eb9-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-c0f269cd-309a-492d-8fd9-99a01ed66eb9-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-c0f269cd-309a-492d-8fd9-99a01ed66eb9" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-c0f269cd-309a-492d-8fd9-99a01ed66eb9" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecaecd6-bbf9-4447-ad9e-1b8592b4b890]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:52 devstack sudo[91901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9
Feb 27 01:34:52 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:52 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:52 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a" returned: 0 in 0.439s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info
Feb 27 01:34:53 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9" returned: 0 in 0.476s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9
Feb 27 01:34:53 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-df68bb90-e3d7-4f67-9097-07dc551c41bd-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Lock "cinder-df68bb90-e3d7-4f67-9097-07dc551c41bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-df68bb90-e3d7-4f67-9097-07dc551c41bd" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-df68bb90-e3d7-4f67-9097-07dc551c41bd" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca40793-ce1c-49d4-bee9-bf0564cd4747]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info" returned: 0 in 0.429s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:53 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info is being set with open permissions: ugo+rw
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:53 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack sudo[91913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info
Feb 27 01:34:53 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-c0f269cd-309a-492d-8fd9-99a01ed66eb9" returned: 0 in 0.440s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-c0f269cd-309a-492d-8fd9-99a01ed66eb9" released by "delete_volume" :: held 0.936s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['cc8b7808-08cf-4731-b4d1-cacf43527d2d', '50790fbb-62e1-4906-a9fe-2af12f6df59f', 'dd8536b1-fc52-4381-8a38-a014b70d53e0', 'a07923b5-2701-472c-b610-5c998dcf970a'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:53 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-c41435fd-4fb3-4305-8c9f-dc76aa379d40-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-c41435fd-4fb3-4305-8c9f-dc76aa379d40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-3223ad8e-cff4-4df9-9e37-82983c1629e4" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-3223ad8e-cff4-4df9-9e37-82983c1629e4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-c41435fd-4fb3-4305-8c9f-dc76aa379d40" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-c41435fd-4fb3-4305-8c9f-dc76aa379d40" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleting offline snapshot c41435fd-4fb3-4305-8c9f-dc76aa379d40 of volume 3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] snapshot_file for this snap is: volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a3ea1-fa5f-483d-8052-cfa1ea466c19]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.info" returned: 0 in 0.435s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:53 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.284s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-898308566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e707f10b-5e15-4303-8742-8fcf2c2e7c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:51Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Creating volume e707f10b-5e15-4303-8742-8fcf2c2e7c71 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:53 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.552s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:53 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:53 devstack sudo[91924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 1073741824
Feb 27 01:34:53 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack sudo[91923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40
Feb 27 01:34:53 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:53 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-80cac4a2-3f3e-4d32-ada7-531e88f8e73b tempest-SnapshotDependencyTests-609615862 None] Create snapshot completed successfully
Feb 27 01:34:53 devstack sudo[91926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd
Feb 27 01:34:53 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:54 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.425s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:54 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleted volume successfully.
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-d417342b-9584-41b9-83da-b322e84003bd tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-c0f269cd-309a-492d-8fd9-99a01ed66eb9-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:54 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40" returned: 0 in 0.511s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3223ad8e-cff4-4df9-9e37-82983c1629e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f4db9-ea98-4bab-b3b7-c8c3a2912f91]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:54 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-df68bb90-e3d7-4f67-9097-07dc551c41bd" returned: 0 in 0.462s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 1073741824" returned: 0 in 0.489s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-df68bb90-e3d7-4f67-9097-07dc551c41bd" released by "delete_volume" :: held 1.055s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Created reservations ['037d486c-7da8-4275-888c-146ef8224ca6', 'ce840f34-8891-4da2-916c-3b0d89e2bc7e', 'ada5377b-a4b0-4ef9-8b65-8bbdff69eb47', '12211283-b839-41e6-b106-86f3e2adada4'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:54 devstack sudo[91938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71
Feb 27 01:34:54 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:54 devstack sudo[91937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4
Feb 27 01:34:54 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:54 devstack sudo[91941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:54 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:54 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4" returned: 0 in 0.475s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:54 devstack sudo[91947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40
Feb 27 01:34:54 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:54 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-591084903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb9b64-724a-468c-b069-98c3063c2b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Creating volume a2fb9b64-724a-468c-b069-98c3063c2b7f {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:54 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4dd8a4-7fa6-47a4-82d7-6b842b70d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:54 devstack sudo[91950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f 1073741824
Feb 27 01:34:54 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d90fa73-1006-440f-8548-14b5bf2ae5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:54 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 (e707f10b-5e15-4303-8742-8fcf2c2e7c71): created successfully
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d90fa73-1006-440f-8548-14b5bf2ae5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (a0585e9a-3459-46d3-a95a-d2005323c054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:54 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3c9234d9-5773-4c93-ae95-dbaeb4142776 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created volume successfully.
Feb 27 01:34:54 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.491s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:54 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Deleted volume successfully.
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5bace91c-3289-44fb-a039-98a968f0f3cd tempest-VolumeDependencyTests-276539862 None] Lock "cinder-df68bb90-e3d7-4f67-9097-07dc551c41bd-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:55 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:55 devstack sudo[91958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40
Feb 27 01:34:55 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Flow 'volume_create_manager' (25898846-cf09-4636-bcf6-0e40510b0f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b829f2eb-2f11-4fe1-8345-ad177927bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b829f2eb-2f11-4fe1-8345-ad177927bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de688117-8884-4ef0-bdd6-b4c456465491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19919bf774d1489cf135bd2093727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c969f9ee-07cb-4b47-933d-6a60bec24f5a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:55Z,use_quota=True,user_id='3c1f6e0793f249958af29034a33e4f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7248fb8d-ebe0-4c6d-ad33-5dd00f06589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7248fb8d-ebe0-4c6d-ad33-5dd00f06589d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1681aac5-08d5-4041-81d2-704c0c183692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1681aac5-08d5-4041-81d2-704c0c183692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de688117-8884-4ef0-bdd6-b4c456465491', 'volume_name': 'volume-de688117-8884-4ef0-bdd6-b4c456465491', 'volume_size': 1, 'snapshot_id': 'c969f9ee-07cb-4b47-933d-6a60bec24f5a'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fd0386-5a96-48c9-8d50-c263ea7fcca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fd0386-5a96-48c9-8d50-c263ea7fcca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e8be6-b763-478c-8950-b398eb432578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Volume de688117-8884-4ef0-bdd6-b4c456465491: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de688117-8884-4ef0-bdd6-b4c456465491', 'volume_size': 1, 'snapshot_id': 'c969f9ee-07cb-4b47-933d-6a60bec24f5a'}
Feb 27 01:34:55 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f 1073741824" returned: 0 in 0.598s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:55 devstack sudo[91960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f
Feb 27 01:34:55 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:55 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4.c41435fd-4fb3-4305-8c9f-dc76aa379d40" returned: 0 in 0.437s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (d01d8019-dd6b-4da1-a833-ae8561877e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211031e0-810a-40a4-8ec1-8a8a08e327c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211031e0-810a-40a4-8ec1-8a8a08e327c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1683918356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4b6e36-395f-4fb0-87a1-816c67e5b5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5189582c1f3e4cdca94c42e3372bf561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:56Z,use_quota=True,user_id='e3a8f7bc990743a18c4e9e4b48fe7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f510ae1-a5c5-46e8-8f35-ebd75f81a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f510ae1-a5c5-46e8-8f35-ebd75f81a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dda590-581c-495c-9b4e-b7d0c279ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dda590-581c-495c-9b4e-b7d0c279ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'volume_name': 'volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9cb7f9-d5de-40f5-9612-cdf82ce81aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9cb7f9-d5de-40f5-9612-cdf82ce81aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d18443-7348-4ffd-b11e-f3bc300149eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:55 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Volume 0f4b6e36-395f-4fb0-87a1-816c67e5b5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'volume_size': 1}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-c41435fd-4fb3-4305-8c9f-dc76aa379d40" released by "_delete_snapshot" :: held 2.018s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-3223ad8e-cff4-4df9-9e37-82983c1629e4" released by "delete_snapshot" :: held 2.028s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['054745a9-4edf-4ed8-b2a9-f14f29b8361c', '0e519691-d74c-458d-849d-c5906226f724', 'c3ac888f-89a4-494a-a7da-5b30a114e57b', '96a1dabc-cb73-4150-a044-e6abe54a877c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:55 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Delete snapshot completed successfully.
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-31ca9f2a-68f9-4b63-afba-7a3ab7493ec1 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-c41435fd-4fb3-4305-8c9f-dc76aa379d40-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:55 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f" returned: 0 in 0.469s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.921s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1002500873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cf548c-a719-486b-8e5c-26f6d99e22ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Creating volume 72cf548c-a719-486b-8e5c-26f6d99e22ef {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:55 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:55 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d334c1-bbe4-411c-be25-8f9338dd400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fb9b64-724a-468c-b069-98c3063c2b7f', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:56 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef 1073741824
Feb 27 01:34:56 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91108a6-fee2-4fc4-b367-bd989c3112f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume volume-a2fb9b64-724a-468c-b069-98c3063c2b7f (a2fb9b64-724a-468c-b069-98c3063c2b7f): created successfully
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91108a6-fee2-4fc4-b367-bd989c3112f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (15562916-2cc1-44e6-8411-1dd697d486cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-10d2bda5-abf7-4bec-866e-4be17faa07c0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created volume successfully.
Feb 27 01:34:56 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef 1073741824" returned: 0 in 0.463s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:56 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef
Feb 27 01:34:56 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:56 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef" returned: 0 in 0.392s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.572s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75921714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af0420e-1468-4a57-bd98-871ee97ebb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Creating volume 0af0420e-1468-4a57-bd98-871ee97ebb7d {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:56 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587a65e2-d8b2-46cb-a91f-0c1fc6975ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cf548c-a719-486b-8e5c-26f6d99e22ef', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:56 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d 1073741824
Feb 27 01:34:56 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cd7e5f-baed-481a-bd72-e66aab48775d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:56 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume volume-72cf548c-a719-486b-8e5c-26f6d99e22ef (72cf548c-a719-486b-8e5c-26f6d99e22ef): created successfully
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cd7e5f-baed-481a-bd72-e66aab48775d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (45df48e6-59f2-44bb-838b-4d975b30c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-3223ad8e-cff4-4df9-9e37-82983c1629e4-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:56 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-d8e68c6d-8720-422f-ab5c-de8477a8c60a tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created volume successfully.
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-3223ad8e-cff4-4df9-9e37-82983c1629e4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "cinder-quobyte-3223ad8e-cff4-4df9-9e37-82983c1629e4" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-3223ad8e-cff4-4df9-9e37-82983c1629e4" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be749ce-69ea-474f-ba46-aeb18be2866b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:56 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:57 devstack sudo[91974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4
Feb 27 01:34:57 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:57 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d 1073741824" returned: 0 in 0.479s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:57 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d
Feb 27 01:34:57 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:57 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4" returned: 0 in 0.510s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:57 devstack sudo[91984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4
Feb 27 01:34:57 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:57 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d" returned: 0 in 0.421s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.286s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-80257134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc700a941a2145ccb01882681f954c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:52Z,use_quota=True,user_id='e23c89dd74174df8b6a0a8bd3d43ee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Creating volume 98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:57 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:57 devstack sudo[91988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a 1073741824
Feb 27 01:34:57 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da57b80-f40c-483e-8bdc-706f57c33b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af0420e-1468-4a57-bd98-871ee97ebb7d', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a1fc0b-1952-48d4-b693-fefa9036e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:57 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume volume-0af0420e-1468-4a57-bd98-871ee97ebb7d (0af0420e-1468-4a57-bd98-871ee97ebb7d): created successfully
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a1fc0b-1952-48d4-b693-fefa9036e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (acbc121e-6d22-4c3a-b86c-36a2de3ead3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:57 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-4744f835-b016-4f81-b37f-4e7fdbec83a5 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created volume successfully.
Feb 27 01:34:57 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-3223ad8e-cff4-4df9-9e37-82983c1629e4" returned: 0 in 0.420s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-quobyte-3223ad8e-cff4-4df9-9e37-82983c1629e4" released by "delete_volume" :: held 0.967s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:57 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Created reservations ['336ba6fc-ba14-4f59-bb67-af96cd3ee819', 'ad417fdc-a9af-4d00-811f-f11a64c9e20b', 'a91236aa-881f-4d2f-8664-4fbe8b8af3e3', '98e85f2a-f049-4092-8db3-cd768a7f939e'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:58 devstack sudo[91991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:34:58 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:58 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a 1073741824" returned: 0 in 0.549s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:58 devstack sudo[91997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a
Feb 27 01:34:58 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:58 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.487s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:34:58 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Deleted volume successfully.
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-986c0044-bd25-4a6b-87ac-03b49b2542f7 tempest-CreateVolumesFromSnapshotTest-1572302344 None] Lock "cinder-3223ad8e-cff4-4df9-9e37-82983c1629e4-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:34:58 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a" returned: 0 in 0.463s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.377s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-quobyte-c969f9ee-07cb-4b47-933d-6a60bec24f5a-de688117-8884-4ef0-bdd6-b4c456465491" by "_create_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fee50cc-64c7-4628-9d17-09defe2b20de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1fba8d-8000-4e87-8d93-2b5dcce5aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-c969f9ee-07cb-4b47-933d-6a60bec24f5a-de688117-8884-4ef0-bdd6-b4c456465491" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Creating volume de688117-8884-4ef0-bdd6-b4c456465491 from snapshot c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-quobyte-de688117-8884-4ef0-bdd6-b4c456465491" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:58 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Volume volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a (98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a): created successfully
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1fba8d-8000-4e87-8d93-2b5dcce5aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Flow 'volume_create_manager' (3e6bebec-2359-4d5f-8c41-b6d14427eedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:58 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-262a4d38-65f7-4e33-b043-e9ac63919e16 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created volume successfully.
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-de688117-8884-4ef0-bdd6-b4c456465491" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] snapshot: c969f9ee-07cb-4b47-933d-6a60bec24f5a, volume: de688117-8884-4ef0-bdd6-b4c456465491,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a5c521-f1de-4834-a9b0-16066b2b8afa]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:58 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-quobyte-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c034827-8932-4c6e-9268-a13e2f117707]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:59 devstack sudo[92000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a
Feb 27 01:34:59 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:59 devstack sudo[92001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a
Feb 27 01:34:59 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:59 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a" returned: 0 in 0.556s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e33777-180b-4340-ad00-de8519486436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[59acfa3d-011b-4faa-835d-ddd279d0c736]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:59 devstack sudo[92007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:34:59 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:59 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a" returned: 0 in 0.592s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:34:59 devstack sudo[92013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a
Feb 27 01:34:59 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Flow 'volume_create_manager' (738486d3-a3d8-4bf6-bc8f-320d3909437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6d4195-d47c-42b2-883e-f2c07467138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6d4195-d47c-42b2-883e-f2c07467138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561f01bb-a240-4a70-8ebb-719112faf6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bd21c89064a71b46c120dafd2fbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:35:00Z,use_quota=True,user_id='0a6bda39ac9440fd8cf5bcf0ca2a3600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96967fbd-f7d8-4c71-911a-f45343fb7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96967fbd-f7d8-4c71-911a-f45343fb7c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419b57ab-44ce-4893-a435-6d533e111905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419b57ab-44ce-4893-a435-6d533e111905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561f01bb-a240-4a70-8ebb-719112faf6fb', 'volume_name': 'volume-561f01bb-a240-4a70-8ebb-719112faf6fb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ba4c5-7524-4a73-a14a-9962cd8dad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ba4c5-7524-4a73-a14a-9962cd8dad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccb50f0-b6af-4e74-bfe6-d29ca25fc6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:34:59 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Volume 561f01bb-a240-4a70-8ebb-719112faf6fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561f01bb-a240-4a70-8ebb-719112faf6fb', 'volume_size': 1}
Feb 27 01:34:59 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:00 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.536s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:00 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a" returned: 0 in 0.430s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:00 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491
Feb 27 01:35:00 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a" released by "delete_volume" :: held 1.054s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created reservations ['74e6254b-664c-4591-8d96-92b20d1858a2', '7ca95d52-f9aa-4a03-aac5-253e6fa0b97c', '6e07d99f-0fc9-4dcd-8233-63eb5ca21e4b', 'a3c8da4f-0c08-425d-a94c-e511aac5732f'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:00 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:00 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:00 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.528s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:00 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Deleted volume successfully.
Feb 27 01:35:00 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-121118e4-7ee8-4a5c-82ff-09cba7b5269d tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-98fc5e2c-10b9-4dca-b166-f7fa7b2bd64a-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-0af0420e-1468-4a57-bd98-871ee97ebb7d-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-0af0420e-1468-4a57-bd98-871ee97ebb7d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-quobyte-0af0420e-1468-4a57-bd98-871ee97ebb7d" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:01 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-0af0420e-1468-4a57-bd98-871ee97ebb7d" acquired by "delete_volume" :: waited 0.023s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:01 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[298aec75-a16d-4be8-a742-e1e013f99fe7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:01 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:01 devstack sudo[92034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d
Feb 27 01:35:01 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:02 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d" returned: 0 in 0.729s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:02 devstack sudo[92039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d
Feb 27 01:35:02 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:02 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491" returned: 0 in 2.160s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904569f-050d-4c56-836d-eed3f2facbfb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:02 devstack sudo[92041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:35:02 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:02 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0af0420e-1468-4a57-bd98-871ee97ebb7d" returned: 0 in 0.423s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-0af0420e-1468-4a57-bd98-871ee97ebb7d" released by "delete_volume" :: held 1.188s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created reservations ['5d63690c-8be0-467e-bdf4-52cd5048b1d8', '531e4138-19c3-470e-947f-37d7abb0f584', '56b127bb-13d4-4100-9510-bd561e76e296', '370ec03a-f468-4235-b694-593b92a60711'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:02 devstack sudo[92046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:02 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:02 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.589s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:35:02 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Converted 1024.00 MB image at 473.76 MB/s
Feb 27 01:35:02 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 is being set with open permissions: ugo+rw
Feb 27 01:35:02 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:02 devstack sudo[92049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491
Feb 27 01:35:02 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:03 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.403s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:03 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Deleted volume successfully.
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-596339e3-f9b2-4ef8-80cb-e537f2ffb4b8 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-0af0420e-1468-4a57-bd98-871ee97ebb7d-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:03 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491" returned: 0 in 0.410s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-de688117-8884-4ef0-bdd6-b4c456465491" released by "_copy_volume_from_snapshot" :: held 4.344s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-c969f9ee-07cb-4b47-933d-6a60bec24f5a-de688117-8884-4ef0-bdd6-b4c456465491" released by "_create_volume_from_snapshot" :: held 4.387s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.411s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.448s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1683918356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4b6e36-395f-4fb0-87a1-816c67e5b5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5189582c1f3e4cdca94c42e3372bf561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:34:56Z,use_quota=True,user_id='e3a8f7bc990743a18c4e9e4b48fe7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Creating volume 0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:35:03 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:03 devstack sudo[92053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 1073741824
Feb 27 01:35:03 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e8be6-b763-478c-8950-b398eb432578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de688117-8884-4ef0-bdd6-b4c456465491', 'volume_size': 1, 'snapshot_id': 'c969f9ee-07cb-4b47-933d-6a60bec24f5a'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2920f-5e86-4554-ab92-8ca330c6a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:03 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Volume volume-de688117-8884-4ef0-bdd6-b4c456465491 (de688117-8884-4ef0-bdd6-b4c456465491): created successfully
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2920f-5e86-4554-ab92-8ca330c6a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Flow 'volume_create_manager' (25898846-cf09-4636-bcf6-0e40510b0f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:03 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-6883eaa8-6314-4aa5-8ce2-6308338bba9c tempest-SnapshotDependencyTests-609615862 None] Created volume successfully.
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-72cf548c-a719-486b-8e5c-26f6d99e22ef-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-72cf548c-a719-486b-8e5c-26f6d99e22ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-quobyte-72cf548c-a719-486b-8e5c-26f6d99e22ef" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-72cf548c-a719-486b-8e5c-26f6d99e22ef" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[4259326b-2303-4ef4-b3b4-e9767c3ef21e]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:03 devstack sudo[92055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef
Feb 27 01:35:03 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:03 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 1073741824" returned: 0 in 0.515s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:03 devstack sudo[92060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:03 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-c969f9ee-07cb-4b47-933d-6a60bec24f5a-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:03 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-c969f9ee-07cb-4b47-933d-6a60bec24f5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-quobyte-18e33777-180b-4340-ad00-de8519486436" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-18e33777-180b-4340-ad00-de8519486436" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-quobyte-c969f9ee-07cb-4b47-933d-6a60bec24f5a" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-c969f9ee-07cb-4b47-933d-6a60bec24f5a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Deleting offline snapshot c969f9ee-07cb-4b47-933d-6a60bec24f5a of volume 18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] snapshot_file for this snap is: volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ae105f-2c72-4803-8cbb-f38a70a21983]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:04 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef" returned: 0 in 0.520s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:04 devstack sudo[92065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a
Feb 27 01:35:04 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:04 devstack sudo[92066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef
Feb 27 01:35:04 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:04 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.445s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.409s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561f01bb-a240-4a70-8ebb-719112faf6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bd21c89064a71b46c120dafd2fbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:35:00Z,use_quota=True,user_id='0a6bda39ac9440fd8cf5bcf0ca2a3600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Creating volume 561f01bb-a240-4a70-8ebb-719112faf6fb {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:35:04 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d18443-7348-4ffd-b11e-f3bc300149eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:04 devstack sudo[92070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb 1073741824
Feb 27 01:35:04 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286c9321-7b82-4629-a757-9a5b03b77396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:04 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Volume volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 (0f4b6e36-395f-4fb0-87a1-816c67e5b5d0): created successfully
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286c9321-7b82-4629-a757-9a5b03b77396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (d01d8019-dd6b-4da1-a833-ae8561877e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:04 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-eecb820c-f57e-46e9-b722-cfb507a1faa4 tempest-VolumeDependencyTests-276539862 None] Created volume successfully.
Feb 27 01:35:04 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a" returned: 0 in 0.462s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e33777-180b-4340-ad00-de8519486436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[081fde72-17c0-4ed2-a0cb-78cbcd5a0a2b]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:04 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-72cf548c-a719-486b-8e5c-26f6d99e22ef" returned: 0 in 0.445s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-72cf548c-a719-486b-8e5c-26f6d99e22ef" released by "delete_volume" :: held 0.990s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created reservations ['4556ff02-9324-45e8-b470-8f4808e769ad', '3aba1bfd-01d6-46ae-a5a3-8a28f3deaffe', 'e828e9b7-2f3f-42d5-8164-41a977a5ed98', '423c5dce-9f09-4412-a0fb-d18376a3a057'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:04 devstack sudo[92076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:35:04 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:04 devstack sudo[92080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:04 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:04 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb 1073741824" returned: 0 in 0.497s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:04 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:04 devstack sudo[92083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb
Feb 27 01:35:04 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:05 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:05 devstack sudo[92089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a
Feb 27 01:35:05 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:05 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:05 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Deleted volume successfully.
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-59da706d-ab17-42ea-83b1-83086cb9e439 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-72cf548c-a719-486b-8e5c-26f6d99e22ef-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:05 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb" returned: 0 in 0.408s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccb50f0-b6af-4e74-bfe6-d29ca25fc6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561f01bb-a240-4a70-8ebb-719112faf6fb', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4e61de-c044-41b1-9ed9-3570932a75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Volume volume-561f01bb-a240-4a70-8ebb-719112faf6fb (561f01bb-a240-4a70-8ebb-719112faf6fb): created successfully
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4e61de-c044-41b1-9ed9-3570932a75f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Flow 'volume_create_manager' (738486d3-a3d8-4bf6-bc8f-320d3909437e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:05 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c7d1e923-f91e-4eb0-b046-40157107bd5b tempest-CinderUnicodeTest-325193103 None] Created volume successfully.
Feb 27 01:35:05 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:05 devstack sudo[92095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a
Feb 27 01:35:05 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (fe31c3fa-cef2-4562-8a57-1b7a9b6d7f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37eb5207-7524-4f09-974a-3fc8df97a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37eb5207-7524-4f09-974a-3fc8df97a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1104859550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79394090-ed8c-4ec8-bd15-f8e405899dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5189582c1f3e4cdca94c42e3372bf561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0f4b6e36-395f-4fb0-87a1-816c67e5b5d0,status='creating',terminated_at=None,updated_at=2026-02-27T00:35:06Z,use_quota=True,user_id='e3a8f7bc990743a18c4e9e4b48fe7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b18ae83-ca2d-4a5d-a873-376ef23ed131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b18ae83-ca2d-4a5d-a873-376ef23ed131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652a6629-dbf6-4f12-99ad-cb717ec03d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652a6629-dbf6-4f12-99ad-cb717ec03d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '79394090-ed8c-4ec8-bd15-f8e405899dec', 'volume_name': 'volume-79394090-ed8c-4ec8-bd15-f8e405899dec', 'volume_size': 1, 'source_volid': '0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f318e510-bf15-4d58-92ee-de5b211b6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f318e510-bf15-4d58-92ee-de5b211b6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffa3a07-325e-4285-8a92-520e040e1259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:05 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Volume 79394090-ed8c-4ec8-bd15-f8e405899dec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-79394090-ed8c-4ec8-bd15-f8e405899dec', 'volume_size': 1, 'source_volid': '0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'source_volstatus': 'available'}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:05 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Cloning volume 0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 to volume 79394090-ed8c-4ec8-bd15-f8e405899dec
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Creating offline snapshot a18564b3-3803-4022-b47c-29a9f8425d12 of volume 0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-a2fb9b64-724a-468c-b069-98c3063c2b7f-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe0515-c38c-4971-b73f-0eba0e9d84c5]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-a2fb9b64-724a-468c-b069-98c3063c2b7f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-quobyte-a2fb9b64-724a-468c-b069-98c3063c2b7f" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-a2fb9b64-724a-468c-b069-98c3063c2b7f" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01f15cf-96ea-4792-b34c-5f8df737c1b8]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:05 devstack sudo[92097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:05 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:05 devstack sudo[92098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f
Feb 27 01:35:05 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:05 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436.c969f9ee-07cb-4b47-933d-6a60bec24f5a" returned: 0 in 0.444s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-c969f9ee-07cb-4b47-933d-6a60bec24f5a" released by "_delete_snapshot" :: held 1.927s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-18e33777-180b-4340-ad00-de8519486436" released by "delete_snapshot" :: held 1.939s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:05 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Created reservations ['2f8a8351-55f7-44f6-8039-a955a5fe4638', 'ee0f366b-64a4-43ef-b764-8a2ce1a976e1', '9cece69a-a236-4e45-9a5e-9b877f313ca0', '1af2a877-75bb-4c16-bb9d-a5e8109db2b1'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:06 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Delete snapshot completed successfully.
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-07733ef7-c6cc-4437-bd49-6c3ca305870e tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-c969f9ee-07cb-4b47-933d-6a60bec24f5a-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-18e33777-180b-4340-ad00-de8519486436-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-18e33777-180b-4340-ad00-de8519486436-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-quobyte-18e33777-180b-4340-ad00-de8519486436" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-18e33777-180b-4340-ad00-de8519486436" acquired by "delete_volume" :: waited 0.006s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4bf8ad-91ad-43cb-a1ae-fe119d52b57c]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:06 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.516s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:06 devstack sudo[92109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 1G
Feb 27 01:35:06 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:06 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f" returned: 0 in 0.508s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:06 devstack sudo[92108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:35:06 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:06 devstack sudo[92111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f
Feb 27 01:35:06 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83910) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Flow 'volume_create_manager' (cc01ff6b-d175-438f-b3cd-b688e20065e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfa0899-bfaa-4da9-8388-f1db4eb33407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfa0899-bfaa-4da9-8388-f1db4eb33407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:35:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-976150962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bd21c89064a71b46c120dafd2fbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:35:07Z,use_quota=True,user_id='0a6bda39ac9440fd8cf5bcf0ca2a3600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2638be-fe23-48ad-a416-b3a521ac709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2638be-fe23-48ad-a416-b3a521ac709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b19d976-efd3-448a-b31c-32500881a739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b19d976-efd3-448a-b31c-32500881a739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3', 'volume_name': 'volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b0f9e7-f4b3-4b94-a83b-0fbb2576a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b0f9e7-f4b3-4b94-a83b-0fbb2576a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d6eb4e-b7f7-4560-9399-860c551648d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:06 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Volume 5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3', 'volume_size': 1}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:06 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.523s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:06 devstack sudo[92121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436
Feb 27 01:35:06 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:06 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-a2fb9b64-724a-468c-b069-98c3063c2b7f" returned: 0 in 0.488s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:06 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 1G" returned: 0 in 0.551s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-a2fb9b64-724a-468c-b069-98c3063c2b7f" released by "delete_volume" :: held 1.040s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:06 devstack sudo[92123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12
Feb 27 01:35:06 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created reservations ['3d2f13b8-297d-4bc7-94c7-d313f12a6f93', '0e76d438-2d77-4a7c-ab3e-fe88d61677fa', '04bab89f-820b-437d-a81b-44007b01418d', '9c77f180-09cf-4528-9edf-734eef04e467'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:06 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:06 devstack sudo[92125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:06 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:07 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-18e33777-180b-4340-ad00-de8519486436" returned: 0 in 0.427s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-18e33777-180b-4340-ad00-de8519486436" released by "delete_volume" :: held 0.999s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Created reservations ['499ace54-1a78-4c86-b026-21ea6a3faf15', '3225796b-b306-4fbe-a9d8-62858a848eee', 'd37efc33-5224-4449-b34a-a99fa239fd28', 'c28fe22e-4509-4a9d-8ec4-e1d308d41ef1'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:07 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12" returned: 0 in 0.453s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:07 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 is being set with open permissions: ugo+rw
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:07 devstack sudo[92132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:07 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:07 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12
Feb 27 01:35:07 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:07 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.423s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Deleted volume successfully.
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5e6cfc67-b588-4886-9119-0233879daa1e tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-a2fb9b64-724a-468c-b069-98c3063c2b7f-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:07 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.404s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:07 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Deleted volume successfully.
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-269d6c90-8294-46bc-b485-08706c2c2a30 tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-18e33777-180b-4340-ad00-de8519486436-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:07 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12" returned: 0 in 0.424s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:07 devstack sudo[92138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info
Feb 27 01:35:07 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-e707f10b-5e15-4303-8742-8fcf2c2e7c71-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-e707f10b-5e15-4303-8742-8fcf2c2e7c71-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-quobyte-e707f10b-5e15-4303-8742-8fcf2c2e7c71" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-e707f10b-5e15-4303-8742-8fcf2c2e7c71" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46ab11-a9f2-425a-aa13-64afb1814752]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:07 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:07 devstack sudo[92141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71
Feb 27 01:35:07 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info" returned: 0 in 0.434s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:08 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info is being set with open permissions: ugo+rw
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:08 devstack sudo[92144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info
Feb 27 01:35:08 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-de688117-8884-4ef0-bdd6-b4c456465491-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-de688117-8884-4ef0-bdd6-b4c456465491-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "cinder-quobyte-de688117-8884-4ef0-bdd6-b4c456465491" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-de688117-8884-4ef0-bdd6-b4c456465491" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb2b79-f498-41c7-8c1e-c3c5d41a0840]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:08 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:08 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71
Feb 27 01:35:08 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack sudo[92149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491
Feb 27 01:35:08 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.info" returned: 0 in 0.447s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-79394090-ed8c-4ec8-bd15-f8e405899dec" by "_copy_volume_from_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-79394090-ed8c-4ec8-bd15-f8e405899dec" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] snapshot: a18564b3-3803-4022-b47c-29a9f8425d12, volume: 79394090-ed8c-4ec8-bd15-f8e405899dec,  {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b61799-32fe-49e9-886b-3bf2d57713a8]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:08 devstack sudo[92154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12
Feb 27 01:35:08 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-e707f10b-5e15-4303-8742-8fcf2c2e7c71" returned: 0 in 0.425s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-e707f10b-5e15-4303-8742-8fcf2c2e7c71" released by "delete_volume" :: held 0.916s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created reservations ['085d209a-a96f-46dc-81c0-98915fffda82', '8d817798-6967-46af-8d44-5d4d705ed07d', '8fde3264-7272-41fc-8749-4bf4ebe6f1e1', '6b42e71f-1d68-4809-8fd5-23c2d4454c26'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:08 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491" returned: 0 in 0.512s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:08 devstack sudo[92160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491
Feb 27 01:35:08 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:08 devstack sudo[92162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:08 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:08 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-7659a4cc-f0e2-4a19-8c29-cec1924608b0-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-7659a4cc-f0e2-4a19-8c29-cec1924608b0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "cinder-quobyte-7659a4cc-f0e2-4a19-8c29-cec1924608b0" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-7659a4cc-f0e2-4a19-8c29-cec1924608b0" acquired by "delete_volume" :: waited 0.013s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598870f-b762-4f36-947d-0a0b8ba88406]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:09 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12" returned: 0 in 0.564s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Creating direct copy from snapshot {{(pid=83910) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2198a06a-0e05-42d2-a09b-a10b527c0f13]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:09 devstack sudo[92167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0
Feb 27 01:35:09 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:09 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:09 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:09 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-de688117-8884-4ef0-bdd6-b4c456465491" returned: 0 in 0.433s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-quobyte-de688117-8884-4ef0-bdd6-b4c456465491" released by "delete_volume" :: held 0.966s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:09 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.402s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:09 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Deleted volume successfully.
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-c7f4aa88-e361-4974-8966-71450f58f8fa tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-e707f10b-5e15-4303-8742-8fcf2c2e7c71-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Created reservations ['fe011ad1-9064-4b6b-a215-ea26316ce31d', 'e1c8baad-b40c-47e3-9001-5c171d15ec9a', '06ebd585-a0ff-4973-9c9a-f6cb187ee7e6', 'db6ae344-36d9-4493-98af-65b9ef32198c'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:09 devstack sudo[92173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:09 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:09 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0" returned: 0 in 0.603s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:09 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.561s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.utils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Path /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec not found in is_blk_device check {{(pid=83910) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:09 devstack sudo[92181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0
Feb 27 01:35:09 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:09 devstack sudo[92182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec
Feb 27 01:35:09 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:09 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.501s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:09 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Deleted volume successfully.
Feb 27 01:35:09 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ce472ab2-bf98-4ef2-ad29-1ec02eeac3cb tempest-SnapshotDependencyTests-609615862 None] Lock "cinder-de688117-8884-4ef0-bdd6-b4c456465491-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:10 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-7659a4cc-f0e2-4a19-8c29-cec1924608b0" returned: 0 in 0.493s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-quobyte-7659a4cc-f0e2-4a19-8c29-cec1924608b0" released by "delete_volume" :: held 1.118s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Created reservations ['92d83fc4-d874-4c29-b615-5e50d12447ff', '03eb248e-af62-4af8-a990-e8ee0456faf2', '7b3abc6c-98fe-425a-9df8-dd0d0fedcf6c', 'cd89f956-0221-4804-bad9-a4e214b00a63'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:10 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:10 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:10 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:11 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:11 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.894s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:11 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:11 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Deleted volume successfully.
Feb 27 01:35:11 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-df0a4892-3980-4a3a-9e0f-3dab86826eb0 tempest-CreateVolumesFromSourceVolumeTest-1634179710 None] Lock "cinder-7659a4cc-f0e2-4a19-8c29-cec1924608b0-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:12 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec" returned: 0 in 2.448s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:12 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[28915f12-eb5e-41ae-89b5-1490652f389d]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:12 devstack sudo[92202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:12 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:12 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.727s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:12 devstack cinder-volume[83910]: DEBUG cinder.image.image_utils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Image conversion details: src /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec {{(pid=83910) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:35:12 devstack cinder-volume[83910]: INFO cinder.image.image_utils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Converted 1024.00 MB image at 418.17 MB/s
Feb 27 01:35:12 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec is being set with open permissions: ugo+rw
Feb 27 01:35:12 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:12 devstack sudo[92207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec
Feb 27 01:35:12 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:13 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec" returned: 0 in 0.450s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-79394090-ed8c-4ec8-bd15-f8e405899dec" released by "_copy_volume_from_snapshot" :: held 4.798s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-a18564b3-3803-4022-b47c-29a9f8425d12" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-a18564b3-3803-4022-b47c-29a9f8425d12" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Deleting offline snapshot a18564b3-3803-4022-b47c-29a9f8425d12 of volume 0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] snapshot_file for this snap is: volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c047e5c9-44be-4cbc-bbcd-1044b0f6cd19]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:13 devstack sudo[92211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12
Feb 27 01:35:13 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:13 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12" returned: 0 in 0.486s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[a647a8f0-50fe-4ccd-aa41-df93eaa887ec]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:13 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:13 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:13 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:14 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.535s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:14 devstack sudo[92222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12
Feb 27 01:35:14 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:14 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12" returned: 0 in 0.501s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:14 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:14 devstack sudo[92227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12
Feb 27 01:35:14 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:15 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0.a18564b3-3803-4022-b47c-29a9f8425d12" returned: 0 in 0.458s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-a18564b3-3803-4022-b47c-29a9f8425d12" released by "_delete_snapshot" :: held 2.027s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.782s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.806s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3ada883040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:35:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-976150962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bd21c89064a71b46c120dafd2fbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:35:07Z,use_quota=True,user_id='0a6bda39ac9440fd8cf5bcf0ca2a3600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c9a9353-c6d7-462b-a4f5-f50f36f3f983),volume_type_id=5c9a9353-c6d7-462b-a4f5-f50f36f3f983)}" {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Creating volume 5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Selected osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9 as target Quobyte volume. {{(pid=83910) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:35:15 devstack cinder-volume[83910]: INFO cinder.volume.drivers.remotefs [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] casted to osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 1073741824 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffa3a07-325e-4285-8a92-520e040e1259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79394090-ed8c-4ec8-bd15-f8e405899dec', 'volume_size': 1, 'source_volid': '0f4b6e36-395f-4fb0-87a1-816c67e5b5d0', 'source_volstatus': 'available'}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92301c29-1b5f-4a07-a49b-e101b519505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:15 devstack sudo[92231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 1073741824
Feb 27 01:35:15 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:15 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Volume volume-79394090-ed8c-4ec8-bd15-f8e405899dec (79394090-ed8c-4ec8-bd15-f8e405899dec): created successfully
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92301c29-1b5f-4a07-a49b-e101b519505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Flow 'volume_create_manager' (fe31c3fa-cef2-4562-8a57-1b7a9b6d7f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:15 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-53eb4fc8-2019-4b75-a4d3-df04af08f71b tempest-VolumeDependencyTests-276539862 None] Created volume successfully.
Feb 27 01:35:15 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 1073741824" returned: 0 in 0.504s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:15 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:16 devstack sudo[92236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3
Feb 27 01:35:16 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" acquired by "delete_volume" :: waited 0.019s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85ce832-e14b-43fa-ab57-d668ada3d6e4]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:16 devstack sudo[92238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:16 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:16 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" returned: 0 in 0.486s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'} {{(pid=83910) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d6eb4e-b7f7-4560-9399-860c551648d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3', 'volume_size': 1}' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c9427-830c-4057-9900-d257bc7f86b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:35:16 devstack cinder-volume[83910]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Volume volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 (5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3): created successfully
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c9427-830c-4057-9900-d257bc7f86b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83910) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Flow 'volume_create_manager' (cc01ff6b-d175-438f-b3cd-b688e20065e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83910) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:35:16 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-8dc7d118-49da-4b94-a2c1-6f5650a561ce tempest-CinderUnicodeTest-325193103 None] Created volume successfully.
Feb 27 01:35:16 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.537s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:16 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:16 devstack sudo[92244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0
Feb 27 01:35:16 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:17 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" returned: 0 in 0.400s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0" released by "delete_volume" :: held 0.968s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Created reservations ['15ab2782-6f4f-4d5c-99e5-1323cfdb9b02', 'dedeb56b-3a67-4b55-9b1e-2b5a0585c88f', '986ee542-0e99-40ab-9f18-faf2ac74cba3', '42cad841-2404-4e50-9cac-5cacf764e814'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-79394090-ed8c-4ec8-bd15-f8e405899dec-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:17 devstack sudo[92247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:17 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Creating offline snapshot 50952485-1365-491c-a08d-64f4c996b48e of volume 5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Lock "cinder-79394090-ed8c-4ec8-bd15-f8e405899dec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25af5b-a5d9-4905-adf8-3ee56118dead]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-79394090-ed8c-4ec8-bd15-f8e405899dec" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-79394090-ed8c-4ec8-bd15-f8e405899dec" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aace245-6a54-4834-a088-68fa860457f7]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:17 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3
Feb 27 01:35:17 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:17 devstack sudo[92250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec
Feb 27 01:35:17 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:17 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.405s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:17 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Deleted volume successfully.
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-e29675fd-b77e-4181-b4f5-224b93a236f0 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-0f4b6e36-395f-4fb0-87a1-816c67e5b5d0-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:17 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" returned: 0 in 0.484s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e 1G {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:17 devstack sudo[92261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e 1G
Feb 27 01:35:17 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:17 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec" returned: 0 in 0.464s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:17 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:17 devstack sudo[92263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec
Feb 27 01:35:17 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:18 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-79394090-ed8c-4ec8-bd15-f8e405899dec" returned: 0 in 0.421s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-79394090-ed8c-4ec8-bd15-f8e405899dec" released by "delete_volume" :: held 0.906s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:18 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e 1G" returned: 0 in 0.470s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:18 devstack sudo[92269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e
Feb 27 01:35:18 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Created reservations ['97ede812-19bf-4e96-8040-5edaa3cb3ed5', 'd179d94f-c0fc-42b2-835c-ffc456b2d055', '55366192-aef5-4728-8ac9-639bc602c47b', 'a5791aa8-ab98-435f-ba87-04651649f832'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:18 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:18 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:18 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 -F qcow2 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e" returned: 0 in 0.411s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:18 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e is being set with open permissions: ugo+rw
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:18 devstack sudo[92277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e
Feb 27 01:35:18 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:18 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.389s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:18 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Deleted volume successfully.
Feb 27 01:35:18 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-2e55757d-116a-42e5-a312-3af081be5e4c tempest-VolumeDependencyTests-276539862 None] Lock "cinder-79394090-ed8c-4ec8-bd15-f8e405899dec-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:19 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e" returned: 0 in 0.387s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:19 devstack sudo[92280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info
Feb 27 01:35:19 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-172ce04c-d34e-4408-9e38-82b6237c95a3-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-172ce04c-d34e-4408-9e38-82b6237c95a3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "cinder-quobyte-172ce04c-d34e-4408-9e38-82b6237c95a3" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-172ce04c-d34e-4408-9e38-82b6237c95a3" acquired by "delete_volume" :: waited 0.007s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55d200-5a3d-47b2-8c86-78e5e544f3fb]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:19 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info" returned: 0 in 0.425s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:19 devstack cinder-volume[83910]: WARNING cinder.volume.drivers.remotefs [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info is being set with open permissions: ugo+rw
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:19 devstack sudo[92284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info
Feb 27 01:35:19 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:19 devstack sudo[92283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3
Feb 27 01:35:19 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:19 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.info" returned: 0 in 0.376s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:19 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-3bed012a-6baa-469d-be55-934fb1b28401 tempest-CinderUnicodeTest-325193103 None] Create snapshot completed successfully
Feb 27 01:35:20 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3" returned: 0 in 0.465s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:20 devstack sudo[92291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3
Feb 27 01:35:20 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-50952485-1365-491c-a08d-64f4c996b48e-delete_snapshot" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Lock "cinder-50952485-1365-491c-a08d-64f4c996b48e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-quobyte-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" by "delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:20 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-quobyte-50952485-1365-491c-a08d-64f4c996b48e" by "_delete_snapshot" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-172ce04c-d34e-4408-9e38-82b6237c95a3" returned: 0 in 0.397s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-50952485-1365-491c-a08d-64f4c996b48e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Deleting offline snapshot 50952485-1365-491c-a08d-64f4c996b48e of volume 5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] snapshot_file for this snap is: volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e {{(pid=83910) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-quobyte-172ce04c-d34e-4408-9e38-82b6237c95a3" released by "delete_volume" :: held 0.894s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eff394-d436-474c-8946-5fed0e9bf3d3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Created reservations ['f93667fa-e1d9-4f22-af10-bd067187cac9', '0cb1f963-ae81-4375-8b29-81be003c2f3a', '851189da-4f35-491a-8f61-83e1d036f4fb', '9fc9fe8b-95cc-43b3-a3b5-4b0a0de68b54'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:20 devstack sudo[92294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e
Feb 27 01:35:20 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:20 devstack sudo[92296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:20 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:20 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.406s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:20 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Deleted volume successfully.
Feb 27 01:35:20 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-99eca3b2-6cd7-4312-a4e9-4fd9cc08fc95 tempest-VolumeDependencyTests-276539862 None] Lock "cinder-172ce04c-d34e-4408-9e38-82b6237c95a3-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:21 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e" returned: 0 in 0.521s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:21 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.remotefs [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83910) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:35:21 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4269d6-862d-468a-9575-9d1d8ccc36f6]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:21 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3
Feb 27 01:35:21 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:21 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" returned: 0 in 0.533s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:21 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:21 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e
Feb 27 01:35:21 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:21 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e" returned: 0 in 0.443s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:22 devstack sudo[92312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e
Feb 27 01:35:22 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:22 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3.50952485-1365-491c-a08d-64f4c996b48e" returned: 0 in 0.394s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-50952485-1365-491c-a08d-64f4c996b48e" released by "_delete_snapshot" :: held 1.944s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" released by "delete_snapshot" :: held 1.960s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Created reservations ['e31cd49e-0fe0-4ef3-99c8-5dbc64f3fe00', 'f2fb671e-f886-4c0f-9a4e-869c9155c8d1', '8801e9f9-2a75-47d6-a343-829fd98d44ed', '88f151ac-5ff4-4460-bfe2-da35032bb3f7'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:22 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Delete snapshot completed successfully.
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-5a527a9f-e85c-4c97-8cb7-5f09dc21ac2f tempest-CinderUnicodeTest-325193103 None] Lock "cinder-50952485-1365-491c-a08d-64f4c996b48e-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-quobyte-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd321851-0cf9-426d-98ad-f7ecb091bce3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:22 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:22 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3
Feb 27 01:35:22 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:23 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" returned: 0 in 0.455s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:23 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3
Feb 27 01:35:23 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:23 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" returned: 0 in 0.403s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3" released by "delete_volume" :: held 0.888s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Created reservations ['74b0f10f-6131-4e61-bba5-1aac84463139', '90b6afbb-494d-4c25-ac17-a3fee78efc8f', '16a8df81-569b-4ed6-b9b0-075152a980c0', 'c569ddd9-c7ba-4eea-8991-055dc12dee18'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:23 devstack sudo[92323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:23 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-561f01bb-a240-4a70-8ebb-719112faf6fb-delete_volume" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-561f01bb-a240-4a70-8ebb-719112faf6fb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "cinder-quobyte-561f01bb-a240-4a70-8ebb-719112faf6fb" by "delete_volume" {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-561f01bb-a240-4a70-8ebb-719112faf6fb" acquired by "delete_volume" :: waited 0.011s {{(pid=83910) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6788c5-b203-4206-9d26-f357e3bde3a3]: (4, 'qcow2') {{(pid=84689) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:23 devstack sudo[92325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb
Feb 27 01:35:23 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:23 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.415s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:23 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Deleted volume successfully.
Feb 27 01:35:23 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-ef68516e-55dc-49fb-884f-632f4979ba05 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-5feea8bc-a86a-4b0c-8c49-e7c2a72d66f3-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:24 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb" returned: 0 in 0.451s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:24 devstack sudo[92331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb
Feb 27 01:35:24 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:24 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15/volume-561f01bb-a240-4a70-8ebb-719112faf6fb" returned: 0 in 0.381s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-quobyte-561f01bb-a240-4a70-8ebb-719112faf6fb" released by "delete_volume" :: held 0.850s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG cinder.quota [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Created reservations ['39670fe1-05b8-402d-9415-322cf9e60641', 'f5dd6068-7fe4-4ac5-ba05-6d735c6e1a04', '3aa91b1d-d685-4f21-bf1f-904b90812841', 'b642157d-1e0d-4402-aa96-2c28777fb0b5'] {{(pid=83910) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:24 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:24 devstack sudo[92334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:24 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:25 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:25 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.415s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:25 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:35:25 devstack cinder-volume[83910]: INFO cinder.volume.manager [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Deleted volume successfully.
Feb 27 01:35:25 devstack cinder-volume[83910]: DEBUG cinder.coordination [None req-76f622ae-f63b-4b6d-8926-e408d1f26c13 tempest-CinderUnicodeTest-325193103 None] Lock "cinder-561f01bb-a240-4a70-8ebb-719112faf6fb-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=83910) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG oslo_service.periodic_task [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83910) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9': None} {{(pid=83910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c2432714-b5f6-441b-a76a-936e0b6015f9'] {{(pid=83910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.lockutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83910) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:35:30 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15 {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:35:30 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15
Feb 27 01:35:30 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:35:31 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Feb 27 01:35:31 devstack cinder-volume[83910]: DEBUG oslo_concurrency.processutils [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/287fbd3a99a78b367b5f611caf142a15" returned: 0 in 0.393s {{(pid=83910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:35:31 devstack cinder-volume[83910]: DEBUG cinder.manager [None req-dc9ab970-7f83-404b-b542-eadfc92a060c None None] Notifying Schedulers of capabilities ... {{(pid=83910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}